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A  BIBLIOGRAPHIC  DATABASE 


FOR  THE  HISTORY  OF  PILOT  TRAINING  SELECTION 

Introduction 

In  August  2009  Damos  Aviation  Services  (DAS)  accepted  Subcontract  TCN  09216  from  Battelle 
Columbus  Operations  under  the  U.S.  Air  Force  Research  Office  Scientific  Services  Program, 
Contract  W91 1NF-07-D-0001  /  Delivery  Order  0906.  This  report  describes  and  documents  the 
bibliographic  database  developed  and  delivered  as  a  result  of  that  subcontract. 

In  previous  work  funded  by  U.S.  Army  Research  Institute  for  the  Behavioral  and  Social 
Sciences  (ARI)  under  an  Army  contract  (DASW01-03-D-0016,  Selection  Instrument  for  Flight 
Training)  DAS  initiated  a  review  and  analysis  of  aviator  selection  in  the  United  States  and  other 
countries  which  led  to  a  technical  report  on  aviator  selection  prior  to  1925  (Damos,  2007).  In  a 
subsequent  effort,  funded  by  ARI  under  Air  Force  contract  FA3089-06-F-0580  (Human 
Resources  Research  Database  and  Strategic  Planning  Support),  DAS  produced  a  bibliographic 
database  of  sources  from  WWI  to  the  present.  DAS  continued  to  survey  the  literature  and 
assemble  relevant  documents  after  completion  of  the  original  database. 


Database  Description 

For  a  variety  of  reasons,  including  resource  limitations,  lack  of  interest,  lack  of  motivation,  or 
plain  ignorance,  there  is  a  tendency  today  for  agencies  to  reduce  or  eliminate  support  for  the 
operation  of  small  libraries  and  reference  collections.  When  support  is  withdrawn  there  is  often 
little  consideration  given  to  the  preservation  of  such  collections.  The  bibliographic  database 
developed  under  this  project  preserves  a  large  number  of  references  and  their  associated  files 
that  may  otherwise  have  been  lost  or  destroyed.  Even  if  the  product  of  the  present  effort  serves 
as  no  more  than  an  archive  it  will  prove  valuable  to  future  research  and  development. 

The  bibliographic  database  contained  herein  was  formed  by  reviewing  objects  available  in  local 
tangible  formats  and  records  accessible  through  linkages  on  the  Internet.  Infonnation  from  these 
was  entered  into  the  database  through  a  database  management  software  package  to  fonn  records. 
Where  possible,  the  full-text  objects  corresponding  to  these  records  were  acquired  and  linked  to 
their  entries.  Review  of  a  large  proportion  of  the  entities  provided  paths  to  other,  previously 
unknown  entities.  For  remote  sources  where  data  retrieval  capabilities  existed  (some  data 
retrieval  capability  exists  with  nearly  every  Internet  resource)  searches  were  perfonned  on  all 
available  data  fields  using  keywords  that  are  commonly  associated  with  aviator  selection 
practices. 

The  entries  in  the  reference  database  are  listed  in  author  order  in  Appendix  B.  Note  that  the  first 
57  entries  have  no  author  listed. 

Limitations.  Objects  entered  as  database  records  are  associated  with  pilot  selection  in  the  United 
States  Anned  Forces  from  the  inception  of  the  employment  of  aviation  by  the  U.S.  military  to  the 
present  day.  There  are  some  records  that  are  primarily  relevant  to  commercial  aviation,  military 
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pilot  selection  in  other  countries,  and  to  general  knowledge,  skill,  ability  and  other  characteristics 
(KSAO)  assessment  for  occupational  or  training  selection.  These  are  included  because  they  bear 
close  association  with  U.S.  military  pilot  selection  and  are  likely  to  be  of  use  to  researchers  in  the 
area.  Web  pages  are  not  included  for  two  reasons:  Few  are  primary  sources  of  information  and 
most  are  ephemeral.  That  is,  there  is  a  high  likelihood  that  a  cited  web  page  will  not  exist  in  the 
near  future. 

Sources.  The  entries  in  the  database  were  retrieved  from  46  documented  sources.  These  are 
listed  in  Table  1  along  with  their  Uniform  Resource  Locators  (URL).  In  addition  to  these 
sources  a  large  portion  of  the  corpus  is  derived  from  personal  holdings  of  the  authors  and  from 
documents  literally  rescued  from  discard.  A  full  set  of  the  Army  Air  Forces  Aviation 
Psychology  Program  Research  Reports  (commonly  known  as  the  Blue  Book)  series  was  retrieved 
by  Dr.  R.  Bruce  Gould  from  a  dumpster  at  Brooks  Air  Force  Base.  A  large  number  of 
documents  was  retrieved  from  the  scientific  reference  files  at  the  Rotary  Wing  Aviation 
Research  Unit  of  the  U.S.  Anny  Research  Institute  for  the  Behavioral  and  Social  Sciences  (ARI). 
These  were  scheduled  to  be  shredded  and  recycled  because  the  building  in  which  they  were 
housed  was  transferred  to  another  agency  and  no  library  would  accept  the  files.  Since  then  the 
remaining  documents  from  that  collection  were  transferred  to  the  Redstone  Scientific 
Infonnation  Center  (RSIC)  at  Redstone  Arsenal,  AL. 
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Table  1.  List  of  sources  for  entries  in  the  bibliographic  database. 


SOURCE  NAME 

URL 

Air  Force  Human  Resources  Laboratory 

None 

Air  Force  Publishing 

https://www.my.af.mil/gcss-af/ 

Air  University  Library  Index  to  Military  Periodicals 

http://www.dtic.mil/dtic/aulimp/index.html 

Air  University  Press 

http://www.maxwell.af.mil/au/aul/aupress/ 

American  Institute  of  Aeronautics  and  Astronautics  (AIAA) 

http://www.aiaa.org/ 

American  Memory 

http://memory.loc.gov/ammem/browse/index 

.html 

American  Psychological  Association  (APA) 

http://www.apa.org 

Army  Administrative  Publications 

http://www.army.mil/usapa/epubs/index.html 

Army  Doctrine  and  Training  Publications 

http://www.army.mil/usapa/doctrine/Active 

FM.html 

Army  Heritage  Collection  Online 

http://www.ahco.army.mil/site/index.jsp 

Center  of  Military  History  Online  Bookshelves 

http://www.army.mil/cmh/online/Bookshelve 

s/Books3.htm 

Defense  Technical  Information  Center  (DTIC)  Public 

Scientific  and  Technical  Information  Network  (STINET) 

http://multisearch.dtic.mil/dtic/ 

Damos  Aviation  Services 

http://www.damosaviation.com 

Donovan  Research  Library  Digitized  Monograph  Collection 

https://www.infantry.army.mil/monographs/ 

Electronic  Code  of  Federal  Regulations 

http://ecfr.gpoaccess.gov/cgi/t/text/text- 
idx?c=ecfr&sid=3efaad  1  b0a259d4e48f  1 1 50 
a34d1aa77 

Google  Books 

http://www.google.com/books 

Headquarters,  U.S.  Army  Medical  Command 

https://www.us.army.mil/suite/portal/index.js 

P 

Human  Factors  and  Ergonomics  Society  (HFES) 

http://www.hfes.org 

Ingenta 

http://www.ingentaconnect.com 

International  Military  Testing  Association  (IMTA) 

http://www.internationalmta.org/ 

International  Symposium  on  Aviation  Psychology  (ISAP), 
Association  for  Aviation  Psychology,  Proceedings 

http://www.wright.edu/isap 

Internet  Archive 

http://www.archive.org 

Joint  Doctrine,  Education  and  Training  Electronic 

Information  System 

https://jdeis.js.mil/ 

Joint  Electronic  Library 

http://www.dtic.mil/doctrine/index.html 

Library  of  Congress 

www.loc.gov/ 

Library,  Information  Science  &  Technology  Abstracts 
(LISTA) 

http://www.libraryresearch.com/ 

Military  Library  Education  Research  Library  Network 
(MERLN)  Digital  Collections 

http://merln.ndu.  edu/index.cfm?lang=EN&p 
agelD=2&type=page 

National  Aeronautics  and  Space  Administration  (NASA) 
Technical  Reports 

http://ntrs.nasa.gov/ 

National  Defense  University  Library  Digital  Collections 

http://www.ndu.edu/Library/index.cfm7seclD 
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=210&pagelD=126&type=section 

Naval  War  College  Newport  Papers 

http://www.nwc.navy.mil/press/npapers/new 

paper.htm 

Pentagon  Library 

http://www.hqda.army.miI/library/m.htm 

Psych  Info 

http://www.apa.org 

PubMed,  National  Library  of  Medicine 

http://www.ncbi.nlm.gov/pubmed/ 

RAND  Review 

http://www.rand.org/publications/randreview 

.html 

RAND  Technical  Reports 

http://www.rand.org/pubs.html 

Scitopia 

http://www.scitopia.org 

U.S.  Army  Military  History  Institute  (AMHI),  Historical 

Services  Division 

http://www.carlisle.army.mil/ahec/MHI.htm 

U.S.  Army  Research  Institute  for  the  Behavioral  and  Social 
Sciences  (ARI)  -  Fort  Rucker  Research  Unit  holdings 

None 

U.S.  Army  Research  Institute  for  the  Behavioral  and  Social 
Sciences  (ARI)  Technical  Library 

http://arit.sirsi.net/uhtbin/cgisirsi/x/0/0/49 

Web  of  Science 

http://science.thomsonreuters.com/training/ 

wos/ 

World  Wide  Science 

http://WorldWideScience.org 

WorldCat 

http://worldcat.org 

United  States  Air  Force  Academy 

http://www.usafa.af.mil/index.asp 

Aviation  Technical  Library,  Fort  Rucker,  AL 

http://www.rucker.army.mil/usaace/techlibra 

ry/index.html 

Navy  Department  Library 

http://www.history.navy.mil/library/index.htm 

U.S.  Naval  Research  Laboratory  Ruth  H.  Hooker  Research 
Library 

http://infoweb.  nrl.  navy,  mil/index.  cfm?i=1 57 

Quantification.  The  database  currently  comprises  1,805  entries  represented  in  20  different  object 
types.  These  object  types  are  as  follows: 

Audiovisual  Material 
Book 

Book  Section 
Chart  or  Table 
Conference  Paper 
Conference  Proceedings 
Edited  Book 
Figure  (Photograph) 

Government  Document 

Journal  Article 

Legal  Rule  or  Regulation 

Magazine  Article 

Manuscript 

Pamphlet 
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Personal  Communication 

Report 

Serial 

Statute 

Thesis 

Unpublished  Work 

The  publication  dates  span  a  range  of  149  years  from  1862  to  2011.  There  are  nine  entries  for 
which  there  is  no  known  year  of  publication.  For  one  entry  the  year  of  publication  is  known  only 
to  the  nearest  decade.  There  are  5,005  authors  cited  and  1,391  keywords  listed.  There  are  57 
entries  that  have  no  author  listed.  The  database  contains  citations  for  articles  from  479  journals. 
Ninety-three  entries  have  associated  URLs.  There  are  two  entries  whose  associated  documents 
are  distribution  restricted  (so  labeled  in  the  Notes  attribute  for  those  entries)  although  the 
database  entries  themselves  are  not  restricted.  No  entries  are  classified  or  sensitive.  There  are 
18  entries  that  are  considered  to  be  incomplete.  These  are  included  in  a  subgroup  in  the  database 
management  software  files.  There  are  721  object  files  linked  to  the  entries.  Most  of  these  are 
digitized  full-text  representations  of  the  original  work  or  digitized  photographs.  There  are  a 
number  of  instances  where  more  than  one  file  is  linked  to  an  entry.  This  is  because  the  size  of 
the  work  makes  it  difficult  to  reliably  operate  the  scanning  and  interpretation  software  employed. 

Scanning  and  Optical  Character  Recognition.  There  are  a  large  number  of  entries  for  which  hard 
copies  were  accessible  but  for  which  digitized  copies  were  not.  These  were  scanned  into 
digitized  files  (Portable  Document  Format  -  pdf)  and  Optical  Character  Recognition  (OCR) 
procedures  were  applied.  The  success  level  of  OCR  software  is  dependent  on  the  quality  of  the 
image  being  interpreted.  If  the  original  image  was  degraded  or  noisy,  then  the  frequency  of 
interpretation  errors  is  increased.  There  are  a  number  of  files  that  are  scanned  but  OCR  success 
was  so  minimal  that  they  have  been  left  unintepreted.  The  internal  content  of  these  files  can  not 
be  automatically  searched. 

Special  mention  should  be  made  of  the  Army  Air  Forces  Aviation  Psychology  Program  Research 
Reports  (Blue  Book)  series.  The  digitized  representations  of  these  works  are  derived  from  two 
sources:  Xerographic  copies  of  some  volumes  that  were  in  the  ARI  holdings  and  digital 
photographic  images  of  volumes  made  by  Brandon  Spillers  from  originals  possessed  by  the  U.S. 
Air  Force.  The  Xerographic  copies  are  of  mediocre  quality  and  may  be  second  generation 
copies.  The  scanned  files  are  therefore  at  best  second  generation,  and  may  be  third  generation 
copies.  As  such  their  image  quality  is  sufficient  to  allow  them  to  be  read  but  not  sufficient  for 
successful  OCR.  The  digitized  images  were  made  as  Tagged  Image  File  Format  (TIFF)  images, 
one  for  each  page.  These  images  were  subsequently  assembled  into  pdf  files,  however,  they  tend 
to  be  somewhat  skewed  and  slightly  out  of  focus.  Therefore  OCR  was  not  successful  on  these. 

Bibliographic  Database  Management  Software.  The  software  used  in  this  project  is  a 
commercially  available  proprietary  package  named  EndNote,  marketed  by  Thompson  Reuters 
(www.endnote.com/).  Version  X4.  This  package  is  designed  to  run  under  Microsoft  Windows 
XP,  Vista,  and  Windows  7  operating  systems  and  under  Macintosh  OS  X.  It  will  interface  with 
several  word  processors  including  Microsoft  Word  2003,  2007,  2010  and  OpenOffice.org  Writer 
3,  as  well  as  with  Macintosh  Pages  ‘09.  There  are  a  number  of  freely  distributed  database 
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management  software  packages  available  which  are  available  at  no  cost  and  are  platform 
(operating  system)  independent.  Three  of  these  are: 


Bibus  http://bibus-biblio.sourceforge.net/wiki/index.php/Main  Page 

JabRef  http://iabref.sourceforge.net/ 

Refbase  http://www.refbase.net/index.php/Web  Reference  Database 


Copyright  Limitations 

Copyright  restrictions  affect  the  uses  to  which  the  database  may  be  applied.  Many  of  the  entries 
in  the  database  are  from  sources  that  retain  copyright.  The  most  common  are  journals  published 
by  the  American  Psychological  Association  (APA).  The  APA  Copyright  and  Permissions  Policy 
(American  Psychological  Association,  2011)  specifically  asserts  control  over  abstracts  of  articles 
published  in  APA  journals.  It  would  be  impractical  to  obtain  permissions  to  use  every  one  of  the 
abstracts  associated  with  APA  journal  articles  in  the  database.  Therefore  the  APA  abstracts  are 
not  present  in  the  database  files.  Many  of  these  have  been  replaced  by  newly  written  abstracts. 

Copyright  restrictions  limit  the  redistribution  (availability)  of  the  associated  digitized  text  files. 
Many  of  the  works  in  the  database  are  in  the  public  domain,  and,  therefore  present  no  problem. 
Government  publications  are  by  their  nature  in  the  public  domain  and  therefore  present  no 
problem.  Many  others,  however,  do  not  belong  to  either  category.  It  has  been  asserted  that 
libraries  and  archives  are  specifically  allowed  to  make  up  to  three  copies  of  a  work  for  the 
purpose  of  preservation  under  the  Digital  Millennium  Copyright  Act  of  1998.  It  has  also  been 
asserted  that  the  Fair  Use  provision  for  individuals  and  libraries  allows  copies  to  be  made  subject 
to  four  factors:  Purpose  of  the  use,  Nature  of  the  Work,  Amount  used,  and  Market  impact.  The 
problem  ensues  from  the  fourth  factor.  Journal  publishers  may  have  an  expectation  of  revenue 
based  on  the  sale  of  reprints  of  articles.  If  one  widely  distributed  digital  copies  of  these  works, 
journal  publishers  could  argue  that  this  distribution  dilutes  their  market. 

In  this  regard  at  least  three  courses  of  action  are  available.  The  first  is  to  make  all  of  the  full  text 
files  unavailable  for  research.  The  second  is  to  sort  through  all  of  the  files  and  make  only  those 
that  are  copyrighted  unavailable.  The  third  is  to  acquire  permissions  to  use  each  of  the 
copyrighted  files. 


User  Instructions 

Disk  Contents.  Accompanying  this  report  is  a  set  of  two  digital  video  disks  (DVD)  that  contain 
the  complete  database  and  related  files.  These  two  DVDs  containing  the  referenced  material 
herein  are  maintained  at  AFPC/DSYX.  This  set  is  the  Digital  Library  of  the  History  of  Pilot 
Training  Selection.  On  Disk  A  of  this  set  an  EndNote  database  is  contained  in  the  file  Aviator 
Selection.enl.  A  co-located  folder,  Aviator  Selection. Data,  contains  a  subfolder,  PDF.  The 
subfolder  PDF  contains  subfolders  that  themselves  contain  the  file  attachments  associated  with 
entries  in  the  database.  The  EndNote  application  packages  file  attachments  in  a  separate  folder 
for  each  database  entry.  In  some  cases  there  are  multiple  files  within  a  subfolder.  Disk  A  also 
contains  the  file  Aviator  Selection.htm,  which  is  a  hypertext  markup  language  (HTML)  listing  of 
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the  complete  entries  in  the  database.  This  file  can  be  read  by  standard  internet  browsers.  Finally, 
Disk  A  contains  a  Standard  Fonn  298  for  the  digital  library  ( sf298.doc ). 

The  size  of  the  complete  library  exceeds  the  capacity  of  a  single  DVD.  Therefore  the  balance  of 
file  attachments  are  on  Disk  B  of  the  set,  in  Aviator  Selection. D ataXPDF .  Disk  B  contains  two 
other  folders.  The  folder  Trash  is  intended  as  a  temporary  location  for  deleted  entries  and  is 
empty.  The  folder  rdb  contains  22  files  that  are  used  by  the  file  management  software.  These 
are  not  intended  to  be  manipulated  by  users. 

Installation.  Please  refer  to  Appendix  A  for  definitions  of  basic  terms  used  here.  To  use  these 
products  as  a  digital  library,  with  EndNote  as  the  reference  management  software  package,  copy 
the  entire  contents  of  Disk  A  to  the  desired  directory  on  a  local  hard  drive.  Then  copy  all  of  the 
entry-specific  subfolders  in  Selection. Data\PDF  on  Disk  B  into  the  subfolder  Aviator 
Selection. Data\PDF  on  the  local  hard  drive.  Assuming  EndNote  has  been  installed,  the  library 
can  be  opened  by  starting  EndNote  and  then  opening  Aviator  Selection. enl  or  by  double  clicking 
on  Aviator  Selection. enl . 

To  use  these  products  as  a  bibliographic  database,  with  EndNote  as  the  reference  management 
software  package,  copy  all  files  as  above  EXCEPT  for  the  subfiles  under  Aviator 
Selection. D ataXPDF .  Doing  this  eliminates  access  to  all  of  the  attached  files  for  database  entries 
(including  copyrighted  materials).  If  access  to  an  attached  file  is  made  within  EndNote,  the 
application  will  issue  an  error  message  stating  that  the  file  can  not  be  found. 

Most  other  bibliographic  database  management  applications  can  import  the  contents  of  an 
HTML  file.  This  is  the  main  reason  for  including  the  file  Aviator  Selection.htm.  Most  other 
bibliographic  database  management  applications  will  not  function  as  digital  libraries,  that  is,  they 
do  not  directly  link  to  full-text  files  associated  with  database  entries. 
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Appendix  A.  Basic  Definitions 


A  bibliographic  database  is  -a-  computer  file  consisting  of  electronic  entries  called  records,  each 
containing  a  uniform  description  of  a  specific  document  or  bibliographic  item,  usually 
retrievable  by  author,  title,  subject  heading  (descriptor),  or  keyword(s).  Some  bibliographic 
databases  are  general  in  scope  and  coverage;  others  provide  access  to  the  literature  of  a  specific 
discipline  or  group  of  disciplines.  An  increasing  number  provide  the  full-text  of  at  least  a 
portion  of  the  sources  indexed.  Most  bibliographic  databases  are  proprietary,  available  by 
licensing  agreement  from  vendors,  or  directly  from  the  abstracting  and  indexing  services  that 
create  them  (Reitz,  2010). 

Reference  management  software  packages  contain  a  bibliographic  database  integrated  with  filter, 
search  and  list  generation  functions.  Most  include  the  capability  of  generating  lists  of  selected 
references  in  specific  formats  required  for  various  publications.  Many  reference  management 
packages  can  be  interfaced  with  commonly  available  word  processors  so  that  a  reference  list  can 
be  produced  as  an  article  is  written.  This  reduces  the  risk  of  cited  sources  being  left  out  of  the 
reference  list  or  of  including  entries  that  are  not  cited  in  the  text.  It  also  can  potentially  reduce 
the  frequency  of  typographical  errors  in  a  reference  list.  Reference  management  software 
packages  usually  have  a  capability  to  import  entries  from  other  bibliographic  databases. 

A  digital  library  is  an  extension  of  the  bibliographic  database  and  reference  management 
software  structures  that  include  full-text  copies  of  the  entries,  stored  in  digital  fonnats  rather  than 
print,  microfilm,  or  similar  media.  The  tenn  Digital  Library  is  defined  by  the  Digital  Library 
Interoperability,  Best  Practices  and  Modeling  Foundations  as  -a-  potentially  virtual  organisation, 
that  comprehensively  collects,  manages  and  preserves  for  the  long  depth  of  time  rich  digital 
content,  and  offers  to  its  targeted  user  communities  specialised  functionality  on  that  content,  of 
defined  quality  and  according  to  comprehensive  codified  policies”  (Candela  et  al.,  2011). 

A  traditional  library,  that  is,  one  containing  directly  tangible  works  in  a  range  of  media  as 
opposed  to  digitized  representations  of  those  works,  requires  substantial  physical  space  and 
consequently  significant  maintenance  cost,  is  limited  by  available  physical  space  and  its 
operations  schedule,  requires  significant  manpower  for  operation,  and  limits  access  by  virtue  of 
its  location  and  by  participant  group  boundaries.  A  digital  library  may  be  made  available 
globally  through  the  Internet,  without  regard  to  time,  allows  multiple  users  to  access  works 
simultaneously,  incurs  no  risk  of  resource  loss  to  patrons,  and  provides  broader  and  faster 
information  retrieval  facility. 
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Appendix  B.  Listing  of  the  Bibliographic  Database  Entries  With  Abstracts 


.  Ground  signals  to  an  aviator.  In  Ground  signals.pdf  (Ed.),  (pp.  Ground  signals.pdf 
Collection:  World  War  I  Miscellaneous-Roy  Coles  Album  2 
Folder:  RG75S-World  War  I  Miscellaneous  Coll. -Roy  Coles  Album  72.28 
Title:  Ground  Signals  to  an  Aviator  ). 

.  Manual  for  the  use  of  the  Student  Pilot  Prediction  System.  Naval  Air  Station,  Pensacola,  FL: 
Naval  Aerospace  Medical  Research  Laboratory. 

.  Airfield  near  San  Antonio.  (192?)  (pp.  Created/Published  [192-?] 

Notes:  Forms  part  of  John  J.  Pershing  Collection.  Title  based  on  similarity  to  panorama 
193  in  this  lot.  Photographer's  address  and  phone  number:  522  Mason  St.,  San  Antonio,  Texas. 
Travis  5384.  Transfer;  LC  Manuscript  Division  (John  J.  Pershing  papers);  1953.  Related  Names: 
San  Antonio  Photo  Service,  photographer. 

Medium:  5381  photographic  print :  gelatin  silver  ;  5389  x  5358.5385  in. 

Call  Number 
LOT  8852  no.  5385 

Special  Terms  of  Use:  No  known  restrictions  on  publication. 

Part  of  Panoramic  photographs  (Library  of  Congress) 

Repository:  Library  of  Congress  Prints  and  Photographs  Division  Washington,  D.C.  20540  USA 
Digital  ID:  (digital  file  from  intennediary  roll  film  copy)  pan  20546a35796 
http://hdl.loc.gov/loc.pnp/pan.20546a35796  ). 

.  Fair  Oaks,  Va.  Prof.  Thaddeus  S.  Lowe  observing  the  battle  from  his  balloon  "Intrepid".  (1862) 
(pp.  CREATED/PUBLISHED  1862  May  1831. 

SUMMARY :  Photograph  from  the  main  eastern  theater  of  war,  the  Peninsular  Campaign, 
May- August  1862. 

NOTES:  Reference:  Civil  War  photographs,  1861-1865  /  compiled  by  Hirst  D.  Milhollen  and 
Donald  H.  Mugridge,  Washington,  D.C.  :  Library  of  Congress,  1977.  No.  0067 
Title  from  Milhollen  and  Mugridge.  Two  plates  form  left  (LC-B 181 1-2348 A)  and  right  (LC- 
B181 1-2348B)  halves  of  a  stereograph  pair. 

Forms  part  of  Civil  War  glass  negative  collection  (Library  of  Congress). 

MEDIUM:  1861  negative  (1862  plates)  :  glass,  stereograph,  wet  collodion. 

CALL  NUMBER:  LC-B  1 8 1 1  -  2348 
REPRODUCTION  NUMBER: 

LC-DIG-cwpb-01560  DLC  (digital  file  from  original  neg.  of  left  half) 

LC-DIG-cwpb-01561  DLC  (digital  file  from  original  neg.  of  right  half) 

LC-B08 17 1-02348  DLC  (b&w  film  copy  neg.) 

SPECIAL  TERMS  OF  USE:  No  known  restrictions  on  publication. 

PART  OF  Selected  Civil  War  photographs,  01861-01865  (Library  of  Congress) 

REPOSITORY:  Library  of  Congress  Prints  and  Photographs  Division  Washington,  D.C.  20540 
USA 

DIGITAL  ID:  (digital  file  from  original  neg.  of  left  half)  cwpb  01560 
http://hdl.loc.gOv/loc.pnp/cwpb.0 1 560 
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(digital  file  from  original  neg.  of  right  half)  cwpb  01561  http://hdl.loc.gov/loc.pnp/cwpb.01561 
(digital  file  from  intermediary  roll  copy  film)  cwp  01564a39678  ). 

.  Annual  Report  of  the  Secretary  of  War  for  the  Year  1885.  Vol  III:  Report  of  the  Chief  of 
Ordnance.  (1885).  Washington,  DC:  U.S.  Government  Printing  Office. 

.  Flying  Machines  Aero  Squadron,  Mobilization  Camp,  Texas  City,  1913.  (1913)  (pp. 
Created/Published  1913. 

Notes:  Copyright  deposit;  Joseph  M.  Maurer;  April  1928,  1913. 

Related  Names 

Maurer,  Joseph  M.,  1876-1953,  copyright  claimant. 

Medium:  1911  photographic  print :  gelatin  silver  ;  1917.1915  x  1960  in. 

Call  Number 

PAN  US  MILITARY  -  Anny  no.  1919 
REPRODUCTION  NUMBER 

LC-USZ1962-52714  DLC  (b&w  film  copy  neg.  of  left  section  made  from  another  print) 
LC-USZ52762-52715  DLC  (b&w  film  copy  neg.  of  center  section  made  from  another  print) 
LC-USZ52762-52716  DLC  (b&w  film  copy  neg.  of  right  section  made  from  another  print) 
Special  Tenns  of  Use:  No  known  restrictions  on  publication. 

Part  of  Panoramic  photographs  (Library  of  Congress) 

Repository: 

Library  of  Congress  Prints  and  Photographs  Division  Washington,  D.C.  20540  USA 
Digital  ID 

(digital  file  from  intermediary  roll  film  copy)  pan  52716a33307 
http://hdl.loc.gov/loc.pnp/pan.52716a33307  ). 

.  Field  Service  Manual  for  Balloon  Companies.  (1917).  Washington,  DC:  Government  Printing 
Office. 

.  "Making  ready",  U.S.  Aviation  Field,  Fairfield,  O.,  June  9th,  1917.  (1917)  (pp. 
Created/Published  1917  June  1919. 

Notes:  Copyright  claimant's  address:  Springfield,  O.  No.  1911.  Copyright  deposit; 
Pixley-Messick  Co.;  June  1912,  1917. 

Related  Names 

Pixley-Messick  Co.,  copyright  claimant,  photographer. 

Medium:  1911  photographic  print :  gelatin  silver  ;  1917.1915  x  1950.1915  in. 

Call  Number 

PAN  US  MILITARY  -  Anny  no.  1918 

Special  Tenns  of  Use:  No  known  restrictions  on  publication. 

Part  of  Panoramic  photographs  (Library  of  Congress) 

Repository:  Library  of  Congress  Prints  and  Photographs  Division  Washington,  D.C.  20540  USA 
Digital  ID 

(digital  file  from  intermediary  roll  film  copy)  pan  20546a33296 
http://hdl.loc.gov/loc.pnp/pan.20546a33296  ). 

.  Notes  on  Cooperation  Between  Aircraft  and  Artillery  During  Recent  Operations  on  the  Second 
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Army  Front.  (1917).  Washington,  DC:  Anny  War  College. 

.  Special  Regulation,  No.  50  Aviation  Section  Signal  Corps.  (1917).  Washington,  DC: 
Government  Printing  Office. 

.  Addendum  to  the  Instruction  on  the  Use  of  Aerial  Observation  in  Liaison  With  the  Artillery. 
(1918)  (pp.  14).  Washington,  DC:  Government  Printing  Office. 

.  Air  Service  Flying  School,  Rockwell  Field,  San  Diego,  Cal.,  Nov.  23,  1918.  (1918)  (pp. 
Created/Published  1918  November  1923. 

Notes:  Copyright  deposit;  Kearny  Photo  Co.;  December  1926,  1918. 

Related  Names 

Keamy  Photo  Service,  copyright  claimant. 

Medium:  1911  photographic  print :  gelatin  silver  ;  1917  x  1946  in. 

Call  Number 

PAN  US  MILITARY  -  Anny  no.  1 153 

Special  Terms  of  Use:  No  known  restrictions  on  publication.  No  renewal  found  in  Copyright 
Office. 

Part  of  Panoramic  photographs  (Library  of  Congress) 

Repository:  Library  of  Congress  Prints  and  Photographs  Division  Washington,  D.C.  20540  USA 
Digital  ID 

(digital  file  from  intermediary  roll  film  copy)  pan  20546a29864 
http://hdl.loc.gov/loc.pnp/pan.20546a29864  ). 

.  Air  Service  Medical  Manual.  (1918).  Washington,  D.C.:  War  Department:  Air  Service  Division 
of  Military  Aeronautics. 

.  Army  Mental  Tests  Methods,  Typical  Results  and  Practical  Applications .  (1918).  Washington, 
D.C. 

.  Aviation  companies,  Love  Field,  Dallas,  Tex.  (1918)  (pp.  Created/Published 
c  1 9 1 8. 

Summary:  Sitters  wearing  their  hats. 

Notes:  Copyright  deposit;  Frederick  W.  Hellenberg;  August  1920,  1918;  DLC/PP-1918:45890. 
Related  Names 

Hellenberg,  Frederick  W.,  copyright  claimant. 

Medium:  45891  photographic  print :  gelatin  silver  ;  45899  x  45844.45895  in. 

Call  Number 

PAN  US  MILITARY  -  Anny  no.  45155 

Special  Terms  of  Use:  No  known  restrictions  on  publication.  No  renewal  found  in  Copyright 
Office. 

Part  of  Panoramic  photographs  (Library  of  Congress) 

Repository:  Library  of  Congress  Prints  and  Photographs  Division  Washington,  D.C.  20540  USA 
Digital  ID 

(digital  file  from  intermediary  roll  film  copy)  pan  45896a29882 
http://hdl.loc.gov/loc.pnp/pan.45896a29882  ). 
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.  Description  and  Instructions  for  the  Use  of  Bomb  Sight,  Markl.  (1918).  (741).  Washington, 
DC:  Government  Printing  Office. 

.  Flying  officers,  Love  Field,  Dallas,  Tex.  (1918)  (pp.  Created/Published 
c  1 9 1 8. 

Notes:  Copyright  deposit;  Frederick  W.  Hellenberg;  August  1920,  1918;  DLC/PP- 
1918:45890. 

Related  Names 

Hellenberg,  Frederick  W.,  copyright  claimant. 

Medium:  45891  photographic  print :  gelatin  silver  ;  45899  x  45841.45895  in. 

Call  Number 

PAN  US  MILITARY  -  Anny  no.  45154 
REPRODUCTION  NUMBER 
LC-USZ45862-135454  DLC  (b&w  film  copy  neg.) 

Special  Terms  of  Use:  No  known  restrictions  on  publication.  No  renewal  found  in  Copyright 
Office. 

Part  of  Panoramic  photographs  (Library  of  Congress) 

Repository:  Library  of  Congress  Prints  and  Photographs  Division  Washington,  D.C.  120540 
USA 

Digital  ID 

(digital  file  from  intermediary  roll  film  copy)  pan  135456al29874 
http://hdl.loc.gov/loc.pnp/pan.135456al29874 
(digital  file  from  b&w  film  copy  neg.)  cph  135453c  135454 
http://hdl.loc.gov/loc.pnp/cph.135453cl35454  ). 

Handbook  of  the  Barlow  Heavy  Drop  Bomb  and  Release  Mechanism.  (1918).  Washington,  DC: 
Government  Printing  Office. 

.  Love  Field  Aviation  Camp,  Dallas,  Texas,  May  30,  1918.  (1918)  (pp.  Created/Published 
1918  May  1930. 

Summary:  Sitters  holding  their  hats. 

Notes:  Copyright  deposit;  Frederick  W.  Hellenberg;  August  1920,  1918;  DLC/PP-1918:45890. 
Related  Names 

Hellenberg,  Frederick  W.,  copyright  claimant. 

Medium:  45891  photographic  print :  gelatin  silver  ;  45899.45895  x  45844.45895  in. 

Call  Number 

PAN  US  MILITARY  -  Anny  no.  45156 

Special  Tenns  of  Use:  No  known  restrictions  on  publication.  No  renewal  found  in  Copyright 
Office. 

Part  of  Panoramic  photographs  (Library  of  Congress) 

Repository:  Library  of  Congress  Prints  and  Photographs  Division  Washington,  D.C.  20540  USA 
Digital  ID 

(digital  file  from  intermediary  roll  film  copy)  pan  45896a29890 
http://hdl.loc.gov/loc.pnp/pan.45896a29890  ). 
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.  Manual  of  Medical  Research  Laboratory.  (1918).  Washington,  D.C.:  War  Department:  Air 
Service  Division  of  Military  Aeronautics. 

Mental  Hygiene.  (1918).  (Vol.  II).  New  York:  National  Committee  for  Mental  Hygiene,  Inc. 

.  Rockwell  Field  Air  Service  Flying  School,  San  Diego,  Cal.  (1918)  (pp.  Created/Published 
c  1 9 1 8. 

Notes:  Copyright  deposit;  Kearny  Photo  Service;  December  1919,  1918. 

Related  Names 

Keamy  Photo  Service,  copyright  claimant. 

Medium:  1911  photographic  print :  gelatin  silver  ;  1917.1915  x  1937.1915  in. 

Call  Number 

PAN  US  MILITARY  -  Camps  no.  1979 

Special  Tenns  of  Use:  No  known  restrictions  on  publication.  No  renewal  found  in  Copyright 
Office. 

Part  of  Panoramic  photographs  (Library  of  Congress) 

Repository:  Library  of  Congress  Prints  and  Photographs  Division  Washington,  D.C.  20540  USA 
Digital  ID 

(digital  file  from  intermediary  roll  film  copy)  pan  20546a30540 
http://hdl.loc.gov/loc.pnp/pan.20546a30540  ). 

.  U.S.  Naval  Air  Station,  San  Diego,  Cal.  (1918)  (pp.  Created/Published 
c  1 9 1 8. 

Notes:  Copyright  deposit;  Kearny  Photo  Service;  December  1927,  1918. 

No.  1913. 

Related  Names 

Keamy  Photo  Service,  copyright  claimant. 

Medium:  1911  photographic  print :  gelatin  silver  ;  1917  x  1938  in. 

Call  Number 

PAN  US  MILITARY  -  Navy  no.  1934 

REPRODUCTION  NUMBER 

LC-USZ 1962- 1239 13  DLC  (b&w  film  copy  neg.) 

Special  Terms  of  Use:  No  known  restrictions  on  publication.  No  renewal  found  in  Copyright 
Office. 

Part  of  Panoramic  photographs  (Library  of  Congress) 

Repository:  Library  of  Congress  Prints  and  Photographs  Division  Washington,  D.C.  120540 
USA 

Digital  ID 

(digital  file  from  intermediary  roll  film  copy)  pan  12391 6a  133061 
http://hdl.loc.gov/loc.pnp/pan.123916al33061 
(digital  file  from  b&w  film  copy  neg.)  cph  1239 13c  1239 13 
http://hdl.loc.gov/loc.pnp/cph.  1239 1 3c  1239 1 3  ). 

.  U.S.  Naval  Air  Station,  San  Diego,  Cal.  (1918)  (pp.  Created/Published 
c  1 9 1 8. 

Notes:  Copyright  deposit;  Kearny  Photo  Service;  December  1928,  1918;  DLC/PP- 
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1919:45967.  No.  N.A.S.45961. 

Related  Names 

Keamy  Photo  Service,  copyright  claimant. 

Medium:  45961  photographic  print :  gelatin  silver  ;  45967  x  45938  in. 

Call  Number 

PAN  US  MILITARY  -  Navy  no.  45938 

Special  Tenns  of  Use:  No  known  restrictions  on  publication.  No  renewal  found  in  Copyright 
Office. 

Part  of  Panoramic  photographs  (Library  of  Congress) 

Repository:  Library  of  Congress  Prints  and  Photographs  Division  Washington,  D.C.  20540  USA 
Digital  ID 
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This  study  assessed  the  effectiveness  of  the  Navy's  Aviation  Score  Sheet  for  selecting 
flight  trainees.  The  Aviation  Score  Sheet  consists  of  a  total  score  and  seven  component  scores: 

(1)  a  personality  rating  (composed  of  ratings  on  five  traits,  which  are  assigned  by  a  senior  naval 
officer  [traits  were  not  mentioned]);  (2)  the  Aviation  Qualification  Test  (AQT;  cognitive  ability); 
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scholastic  perfonnance;  (6)  credit  hours  in  math  and  physics  and  (7)  the  board  evaluation. 
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=  .44)  and  OFQ  (r  =  .12).  The  FAR  conelated  significantly  with  all  four  criteria,  validities 
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A  Brief  Vestibular  Disorientation  Test  (BVDT)  was  developed  that  involves  observer 
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assessment  of  subjects'  reactions  produced  by  head  movements  in  a  rotating  chair.  Reliability  of 
observers  has  been  demonstrated,  and  significant  validation  and  cross-validation  coefficients 
have  been  reported  for  criteria  of  pass  versus  various  types  of  separations  from  pilot  training.  It 
has  also  been  established  that  the  BVDT  score  significantly  augmented  the  multiple  correlation 
of  existing  aviation  selection  variables  with  the  same  criteria.  The  purpose  of  this  study  was  to 
detennine  if  reliability,  validity,  and  augmentation  of  correlation  could  be  obtained  with  less 
disturbance  to  the  subject  than  that  caused  by  the  15-rpm  speed  of  rotation  used  thus  far  in  the 
BVDT.  Reduced  disturbance  and  aftereffects  are  desired  because  the  BVDT  is  now  envisioned 
as  becoming  part  of  the  entering  flight  physical,  and  procedures  that  might  either  impair 
perfonnance  on  the  other  tests  or  require  recovery  periods  must  be  held  to  a  minimum.  The 
BVDT  procedure  used  here  was  identical  to  two  previous  studies  except  that  a  speed  of  10-rpm 
was  used  instead  of  15-rpm.  Subjects  were  157  flight  students  who  were  tested  within  the  first 
four  days  of  reporting  for  training.  Retesting  of  72  of  the  subjects  was  conducted  9  weeks  later. 
The  test-retest  and  rater  reliability  coefficients  obtained  were  not  quite  so  high  as  for  those  who 
had  the  15-rpm  procedure,  but  they  were  of  acceptable  magnitude.  The  validity  coefficients  were 
approximately  the  same  as  those  obtained  for  15-rpm,  and  significant  augmentation  of  the 
existing  selection  battery  and  cost  effectiveness  was  demonstrated.  It  was  concluded,  therefore, 
that  the  10-rpm  BVDT  was  a  feasible  procedure.  It  was  also  concluded  that,  because  the  mean 
score  for  the  10-rpm  group  was  lower  than  the  mean  for  either  of  the  two  15-rpm  groups  used 
previously,  subject  disturbance  had  been  reduced. 
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Past  research  has  demonstrated  the  value  of  the  Brief  Vestibular  Disorientation  Test 
(BVDT)  as  a  screening  tool  for  student  pilots.  This  study  is  concerned  with  the  extension  of  this 
technique  for  use  in  assessing  the  potential  Naval  Flight  Officer  (NFO).  The  rater  BVDT 
procedure  was  used  here,  and  in  addition,  a  performance  task  involving  a  short-  tenn  memory 
task  in  the  auditory  mode  was  introduced  in  order  to  measure  perfonnance  decrement. 
Representative  groups  of  entering  NFO  students  were  first  administered  the  perfonnance  task 
under  the  exact  conditions  of  the  previous  BVDT  procedure,  but  without  rotation.  After  a  2- 
minute  rest  period,  the  procedure  was  repeated  with  rotation.  Observer  assessments  were  made 
during  this  rotation  sequence.  The  results  indicate  that  those  students  who  later  failed  NFO 
training  exhibited  greater  performance  decrement  under  rotary  conditions  as  compared  to  static 
than  did  successful  students.  Rater-type  BVDT  scores  also  indicated  slightly  greater  sensitivity 
(.07  level  of  significance)  to  the  vestibular  stimulus  for  the  failures  than  for  the  successes.  It  was 
concluded  that  this  technique  is  of  value  in  screening  NFO's. 
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These  researchers  created  a  special  criterion  measure  reflecting  training  success  for  a 
sample  ofl700  Navy  aviation  trainees  in  three  pilot  and  four  non-pilot  Air  Force  specialties. 

They  then  factor  analyzed  several  personality  and  cognitive  ability  measures  along  with  several 
different  criterion  measures,  in  order  to  detennine  which  of  these  tests  to  include  in  a  selection 
and  classification  battery.  These  measures  included  the  Guilford-Zimmerman  Aptitude  Survey, 
the  Hidden  Figures  test  and  four  tests  from  the  Navy  and  Marine  Corps  aviation  selection  battery 
(including  a  biographical  inventory).  An  initial  factor  analysis  of  the  predictors  alone  yielded  six 
factors:  mechanical,  spatial  manipulation,  perceptual  flexibility,  verbal  intelligence,  numerical 
intelligence  and  flight  motivation.  Other  factor  analyses  were  then  conducted  which  included 
various  combinations  of  the  predictor  measures  and  selected  criterion  measures  (a  pilot/non-pilot 
dichotomous  variable,  a  training  completed  attrition  dichotomous  variable  and  the  special 
criterion  measure  of  training  success).  Several  principal  axis  factor  solutions  were  examined.  The 
most  salient  results  included  relatively  weak  loadings  for  verbal  intelligence  across  all  criteria, 
greater  utility  of  numerical  intelligence  for  non-pilot  versus  pilot  specialties  and  large  loadings 
for  flight  motivation  across  all  criterion  combinations.  Based  on  these  results,  the  authors  suggest 
reducing  the  emphasis  on  the  verbal  intelligence  component  in  selection  and  further  exploring 
the  construct  of  flight  motivation. 
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While  the  Spatial  Disorientation  (SD)  has  long  been  recognized  as  an  important  causal 
factor  in  aviation  incidents  and  accidents,  it  is  only  beginning  to  be  recognized  as  a  factor  in 
Uninhabited  Aerial  Systems  (UASs).  Self,  Ercoline,  Olson  and  Tvaryanas  (2006)  predicted  SD 
to  be  most  likely  for  a  manually  controlled  UAV  when  operated  from  a  mobile  platfonn.  As  a 
first  step  towards  better  understanding  the  effects  of  control  platform  motion  on  manual  UAV 
control  Olson,  DeLauer  and  Fale  (2006)  had  10  rated  Air  Force  pilots  fly  a  simulated  UAV  task 
(MS  Flight  Simulator)  from  a  motion  capable  control  platform  (aircraft  simulator).  Participants 
perfonned  two  basic  flight  tasks  -  a  vertical  task  (climb/descent)  and  a  horizontal  (turning  task). 
The  control  platform  motion  was  varied  to  provide  either  congruent,  neutral,  or  conflicting 
motion  cues.  Congruent  and  incongruent  motion  cures  were  defined  as  motion  in  the  same  axis 
and  either  same/different  direction  as  the  primary  task  (i.e.,  simulator  turned  left/right  and  task 
was  a  constant  left  hand  turn).  Neutral  motion  was  defined  as  motion  in  a  different  axis  of 
motion  relative  to  the  primary  task  (i.e.,  simulator  motion  was  climb/descent  and  task  was  a 
constant  bank  turn).  There  were  three  levels  of  visual  and  vestibular  control  platfonn  motion 
cues  (no  motion/visual  cues,  motion  with  no  outside  visual  display,  motion  with  outside  visual). 
The  results  indicate  that  there  was  little  effect  of  control  platfonn  motion  on  roll  axis 
perfonnance,  i.e.,  bank  and  heading  error.  However,  pitch  axis  deviations  (altitude  and  vertical 
velocity)  showed  an  effect  of  both  control  platform  motion  and  motion  type.  Presence  of  both 
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visual  and  motion  cues  resulted  in  greater  pitch  deviations  than  motion  only  or  baseline  (no 
motion/no  visual  cue)  conditions  and  the  presence  of  motion  in  the  off-axis  of  motion  resulted  in 
the  greatest  error.  These  results  suggest  that  platform  motion  may  interfere  with  an  operators 
ability  to  manually  control  a  UAV  from  a  moving  platform  (a  possible  precursor  to  SD).  The 
current  study  replicates  the  simulator  study  using  an  aircraft  (C-172)  as  the  control  platform. 

This  will  allow  for  a  more  complete  examination  of  platform  motion  cues  since  simulators 
cannot  adequately  simulate  sustained  motion.  This  study  also  adds  a  landing  task  to  examine 
glide  path  and  azimuth  error.  Data  collection  is  not  yet  complete,  however  initial  results  indicate 
that,  as  in  the  previous  simulator  study,  control  platform  motion  resulted  in  greatest  interference 
in  the  vertical  axis  and  the  presence  of  both  motion  and  visual  cues  resulted  in  the  greatest 
control  interference.  These  results  have  implications  for  planned  UAV  operations  from  both 
lighter  and  transport  aircraft. 
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year  period,  accounting  for  40%  of  attrition  among  survey  respondents.  Perfonnance  related 
attrition  was  37%  of  all  attrition,  with  flight  failure  the  most  frequent  cause  in  this  category,  at 
24%  of  all  attrition.  Self-reported  contributory  factors  were  also  examined.  Survey  response 
options  related  to  anxiety  and  nervousness  related  to  flying  and  to  the  flight  program  were 
among  the  most  frequently  endorsed  contributing  factors.  Among  other  frequently  endorsed 
factors  were  poor  flight  perfonnance,  loss/change  of  interest,  and  motion  sickness.  To  reduce 
training  attrition,  recommendations  are  made  for  S&T  investments  in  aviation  personnel 
selection  research  to  identify  valid  predictors  of  anxiety,  fearfulness,  task  prioritization, 
motivation,  and  motion  sickness  susceptibility. 
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Although  women  have  had  some  visibility  in  aviation  for  many  decades,  their 
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participation  beyond  clerical,  stewardess  or  the  private  pilot  level  is  still  perceived  as  novel. 
Military  aviation  has  been  opened  to  women  on  a  basis  of  career  parity  with  men.  The 
motivation  behind  this  is  twofold:  1)  response  to  the  influences  of  current  cultural  and  legal 
demands  for  equality  of  opportunity  for  women,  and  2)  the  prospect  of  an  enlarged  person-power 
base  from  which  future  personnel  needs  of  an  all-volunteer  force  can  be  filled.  This  expanded 
opportunity  placed  a  burden  on  the  behavioral  and  life  sciences  to:  (1)  examine  the  role  of 
women  in  aviation,  (2)  take  stock  of  existing  knowledge,  (3)  define  areas  of  true  differences  or 
commonality  with  respect  to  the  existing  male  aviation  population,  (4)  identify  problem  areas, 
and  (5)  seek  solutions.  This  overview  will  attempt  to  integrate  certain  existing  knowledge  and 
current  Navy  research  concerning  women  in  aviation.  The  specific  topics  to  be  addressed  cover 
attitude,  aptitude,  performance,  and  human  factors  considerations.  The  anthropometric  problems 
related  to  the  aeronautical  adaptability  of  women  which  are  discussed  include:  (1)  design 
requirements  for  flight  safety,  emergency  egress  and  operator  comfort,  and  (2)  strength 
requirements  related  to  aircraft  flight  control.  Other  research  efforts  discussed  are  (1)  the 
measurement  of  attitudes  of  Navy  and  Marine  Corps  aviation  personnel  toward  women  on 
several  factors,  including  their  acceptance  into  aviation  training,  (2)  the  assessment  of  the 
female‘s  ability  to  handle  multiple  complex  tasks  under  stress,  and  (3)  the  effects  of  the 
menstrual  cycle  on  complex  perceptual-psychomotor  tasks. 
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particularly  minority  students,  had  taken  the  aviation  selection  test  several  times  before 
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naval  aviation  students  has  become  Increasingly  evident.  Recent  exit  Interviews  with  student 
pilots  who  have  voluntarily  withdrawn  from  training  Indicate  that  factors  unrelated  to  mental 
ability  (such  as  attitude  toward  the  military)  often  entered  into  their  decision.  This  study  was 
conducted  to  determine  if  Inclusion  of  the  noncognitive  items  of  the  college  and  flight 
background  questionnaire  would  enhance  the  validity  of  the  existing  primary  selection  process, 
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questionnaires,  when  coupled  with  the  residual  validity  of  the  existing  selection  tests,  were  found 
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implementation  of  the  suggested  technique  would  have  reduced  the  attrition  rate  by  4.5 
percentage  points  in  the  cross-validation  sample.  Thus,  it  was  recommended  that  this  technique 
be  incorporated  as  a  management  tool  at  the  primary  selection  level. 
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These  researchers  conducted  exit  interviews  with  naval  aviation  students  who  had 
voluntarily  withdrawn  from  flight  training  and  found  that  the  reasons  students  withdrew  were 
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Background  Questionnaire  (FBQ),  in  decreasing  the  attrition  rate  and  thus  improving  the  cost 
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An  Air  Force  Human  Resources  Laboratory  (AFHRL)  research  and  development  (R&  )) 
program  was  designed  to  capitalize  on  state-of-the-art  technologies  in  computer-aided  testing  to 
develop  accurate  measures  of  psychomotor  ability  (hand-eye  coordination)  and  then  to 
investigate  different  ways  to  use  these  psychomotor  measures  in  the  selection  of  pilot  training 
candidates  .  Psychomotor  ability  is  one  of  several  characteristics  which  historically  have 
demonstrated  relevance  to  flying  performance  .  This  report  documents  the  validation  of  two  tests 
of  psychomotor  ability  against  USAF  Undergraduate  Pilot  Training  (UPT)  performance,  and 
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selection  gate  for  UPT  candidates.  Three  Integrated  Pilot  Candidate  Selection  Models  (IPCSMs) 
use  all  available  information,  including  psychomotor  measures,  to  improve  attrition  and  quality 
in  UPT  and  also  reduce  the  rejection  of  potential  graduates.  Also,  the  IPCSMs  can  be  used  to 
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The  present  study  was  conducted  in  order  to  determine  whether  1  )  the  California 
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scales  ;  whereas,  only  2  scales  were  significantly  elevated  for  the  DOR  group.  The  results 
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different  types  of  computer  and  safety-pilot  measures  was  as  expected  for  76  percent  of  the 
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As  Unmanned  Combat  Aerial  Vehicles  (UCAVs)  become  integrated  into  the  U.S. 
military's  arsenal,  the  number  of  vehicles  that  an  operator  can  successfully  supervise  will 
play  an  important  role  in  the  effectiveness  of  future  missions.  The  present  study 
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investigated  performance  and  mental  workload  when  an  operator  supervises  multiple 
UCAVs.  This  study  focused  on  the  parameters  that  affect  the  operator's  perfonnance 
during  a  simulated  UCAV  suppression  of  enemy  air  defenses  (SEAD)  mission,  which  is 
expected  to  be  the  primary  function  of  the  UCAV.  All  three  factors  which  were 
manipulated,  including  the  number  of  vehicles  to  be  supervised,  vehicle  airspeed,  and 
difficulty  level  of  attacks  (targets  engaged  by  either  a  single  vehicle  or  multiple  vehicles), 
affected  both  perfonnance  and  Subjective  Workload  Assessment  Technique  (SWAT), 
and  NASA  Task  Load  Index  (TLX),  subjective  mental  workload  measures. 
Accomplishment  score  analyses  were  used  to  estimate  performance  redlines,  based  on  the 
Accomplishment  Score  Model  of  Average  Mental  Workload  (Colle  &  Reid,  1997,  2005). 
A  perfonnance  mental  workload  redline  was  defined  as  the  point  at  which 
accomplishment  scores  no  longer  increased.  Performance  redlines  were  estimated  using 
piecewise  linear  functions  of  accomplishment  scores.  Redlines  indicated  that  for  simple 
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for  both  the  SWAT  and  TLX  subjective  mental  workload  measures  based  on  the 
perfonnance  redlines.  Consistent  with  iv  previous  research,  the  estimated  SWAT  redline 
was  in  the  range  of  40  ±  10.  Initial  estimates  of  a  redline  also  were  obtained  for  the  TLX. 
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High  rates  of  attrition  among  students  in  Undergraduate  Pilot  Training  (UPT)  are  a  major 
concern  for  the  U.S.  Air  Force.  Recent  efforts  at  the  Air  Force  Human  Resources  Laboratory 
have  attempted  to  reduce  attrition  rates  by  improving  the  method  by  which  pilot  candidates  are 
selected.  Currently,  UPT  students  are  chosen  primarily  on  the  basis  of  their  Pilot  and  Navigator- 
Technical  composite  scores  from  the  Air  Force  Officer  Qualifying  Test  (AFOQT).  The  present 
effort  sought  to  determine  the  extent  to  which  scores  on  an  experimental  test  battery,  known  as 
the  Basic  Attributes  Tests  (BAT),  added  to  the  validity  provided  by  the  Pilot  and  Navigator- 
Technical  composite  scores.  The  BAT  battery  consisted  of  eleven  subtests  and  measured 
psychomotor  skills,  as  well  as  a  variety  of  cognitive/perceptual  abilities  and 
personality/attitudinal  characteristics  believed  to  be  related  to  pilot  training  perfonnance. 
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In  1955,  the  U.S.  Air  Force  discontinued  apparatus-based  testing  as  a  component  of  its 
aircrew  selection  and  classification  system  due  to  administrative  problems.  Since  then,  the  Air 
Force  has  relied  on  paper  and  pencil  test  batteries  such  as  the  Air  Force  Officer  Qualifying  Test 
to  select  pilot  and  navigator  trainees.  Unfortunately,  the  aircrew  selection  system  without 
apparatus  testing  has  failed  to  produce  acceptable  attrition  rates  in  the  light  of  escalating  training 
costs.  As  a  result,  a  computer  based  testing  system,  the  Basic  Attributes  Tests  (BAT)  system, 
was  developed  to  assess  psychomotor  skills  as  well  as  a  variety  of  psychological  and  cognitive 
attributes  that  are  believed  to  be  related  to  flight  training  perfonnance.  This  paper  evaluated  three 
subtests  used  to  assess  cognitive  abilities:  Perceptual  Speed  (infonnation  input  efficiency), 
Decision  Making  Speed  (low  level  cognitive  and  high  level  sensory-perceptual  motor 
involvement)  and  Item  Recognition  (short-tenn  memory  storage,  search  and  comparison 
operations).  Each  of  the  subtests  was  evaluated  in  terms  of  its  internal  consistency  and  ability  to 
predict  flight  training  perfonnance.  An  integrated  model,  based  on  results  from  the  three 
cognitive  subtests,  was  evaluated  against  flight  training  perfonnance  criteria. 

Carretta,  T.  R.  (1987).  Basic  attributes  test  (BAT)  system:  Development  of  an  automated  test 
battery  for  pilot  selection.  Brooks  Air  Force  Base,  TX:  Air  Force  Human  Resources 
Laboratory. 

This  report  documents  the  development  of  the  Basic  Attributes  Test  (BAT)  by  the  Air 
Force  and  provided  some  preliminary  validation  results.  A  detailed  description  is  given  of  the 
BAT  hardware  and  software,  as  well  as  descriptions  of  each  of  the  tests  that  were  currently  part 
of  the  selection  system  when  this  report  was  written.  Several  personality  measures  were  included 
in  the  system:  (1)  a  Risk  Taking  test;  (2)  Self-crediting  Word  Knowledge  Test  (measures  self 
assessment  ability  and  self-confidence);  (3)  Activities  Interest  Inventory  (measures  survival 
attitudes);  (4)  the  Embedded  Figures  Test  (measures  field  dependence/independence);  and  (5)  the 
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Automated  Aircrew  Personality  Profile  (measures  personality  factors  that  had  not  been 
detennined  at  the  time  of  the  report).  Preliminary  results  for  the  personality  measures  were  not 
very  encouraging,  with  only  the  Self-crediting  Word  Knowledge  test  shown  to  be  predictive  for 
either  training  outcome  (pass/fail)  or  advanced  training  assignment. 

Carretta,  T.  R.  (1987).  Basic  Attributes  Test  (BAT)  System:  A  Preliminary  Evaluation.  Brooks 

AFB,  TX:  Air  Force  Human  Resources  Faboratory. 

Recent  efforts  to  reduce  attrition  rates  in  Air  Force  Undergraduate  Pilot  Training  (UPT) 
have  resulted  in  the  development  of  an  experimental  computer-administered  test  battery,  the 
Basic  Attributes  Test  (BAT)  system.  Included  in  the  battery  are  several  tests  which  measure 
information  processing  efficiency-  and  speed  that  were  identified  in  previous  research  as  being 
related  to  pilot  performance,  particularly  with  regard  to  fast  jet  fighter  aircraft  This  paper 
evaluated  three  subtests  used  to  assess  cognitive  abilities:  Digit  Memory  (information  input 
efficiency),  Decision-Making  Speed  (low-level  cognitive  and  high-level  sensory  perceptual- 
motor  involvement),  an  Item  Recognition  (short-term  memory  storage,  search  and  comparison 
operations).  Each  of  the  subtests  was  evaluated  in  terms  of  its  ability  to  predict  various  flight 
perfonnance  measures  and  final  training  outcome.  Of  particular  interest  was  the  potential  of  the 
cognitive  subtests  to  increase  the  validity  of  current  selection  procedures  that  rely  mainly  on 
paper-and-pencil  measures.  In  addition,  an  integrated  model  containing  both  the  current  selection 
measure  and  experimental  subtests  did  demonstrate  significant  relationships  with  several  other 
perfonnance  measures  including  recommendations  for  fighter  assignments  after  training. 

Carretta,  T.  R.  (1987).  Field  dependence-independence  and  its  relationship  to  flight  training 

perfonnance.  Brooks  Air  Force  Base,  TX:  Air  Force  Human  Resources  Faboratory. 

Previous  research  has  suggested  that  level  of  field  dependence-  independence  could  be 
used  as  a  measure  of  social  skills  and  vocational  interests.  According  to  this  research,  field- 
dependent  individuals  tend  to  prefer  areas  of  work  that  require  social  skills,  whereas  field- 
independent  individuals  favor  positions  in  the  sciences  or  practical-analytical-oriented 
occupations.  This  study  examined  the  usefulness  of  field  dependence-independence  measure  for 
predicting  performance  during  flight  training.  One  thousand  nine  hundred  seventy-seven  (1,977) 
United  States  Air  Force  pilot  candidates  were  administered  the  Embedded  Figures  Test  as  part  of 
a  computer-administered  test  battery  prior  to  entry  into  Undergraduate  Pilot  Training  (UPT). 
Several  items  on  the  Embedded  Figures  Test  demonstrated  poor  reliability.  Further,  the  level  of 
field  dependence-independence  was  not  found  to  be  related  to  perfonnance  during  flight  training. 
It  was  recommended  that  the  test  be  eliminated  for  consideration  as  a  selection  and  classification 
tool.  Keywords:  Job  analysis;  Flight  crews. 

Carretta,  T.  R.  (1987).  Spatial  Ability  as  a  Predictor  of  Flight  Training  Perfonnance.  Brooks 

AFB,  TX:  Air  Force  Human  Resources  Faboratory. 

Spatial  ability  has  been  demonstrated  to  be  related  to  Perfonnance  of  a  variety  of  tasks 
including  several  military  enlisted  jobs  and  piloting  aircraft.  This  paper  examined  the 
relationship  between  performance  on  a  spatial  ability  task  (i.e.,  the  Mental  Rotation  Test)  and 
flight  training  perfonnance  for  1,939  United  States  Air  Force  Undergraduate  Pilot  Training 
(UPT)  candidates.  Performance  on  the  Mental  Rotation  Test  was  not  related  to  completion  of 
training,  but  was  related  to  a  recommendation  for  specialized  training  after  UPT.  Pilot  candidates 
who  made  quick,  consistent,  and  accurate  judgments  were  more  likely  to  be  recommended  for 
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fast-jet  training  (Fighter-Attack-Reconnaissance  or  FAR).  This  was  consistent  with  the  current 
practice  of  selecting  the  best-perfonning  student  pilots  for  follow-on  training  in  FAR  aircraft. 

Carretta,  T.  R.  (1987).  Time-Sharing  Ability  as  a  Predictor  of  Flight  Training  Perfonnance. 
Brooks  AFB,  TX:  Air  Force  Human  Resources  Laboratory. 

Modern-day  pilots  must  perfonn  a  variety  of  activities  concurrently.  In  addition  to  flying 
the  aircraft,  they  must  monitor  the  communications  channels  and  instrument  panel  and  also 
navigate.  As  a  result,  the  ability  to  allocate  attention  to  different  tasks  effectively  or  "time  share" 
is  crucial  for  a  safe,  well-executed  flight.  A  compensatory  tracking  and  signal  detection  dual-task 
was  administered  to  1,130  United  States  Air  Force  pilot  training  candidates  prior  to  entry  into 
Undergraduate  Pilot  Training  (UPT).  Tracking  perfonnance  was  extremely  reliable.  Although 
perfonnance  on  this  task  was  not  predictive  of  successful  completion  of  UPT  it  was  related 
significantly  to  a  post-UPT  advanced  training  recommendation.  This  task  may  be  useful  when  it 
is  desirable  to  place  pilot  candidates  into  specialized  training  tracks  at  an  early  point  in  training. 

Carretta,  T.  R.  (1988).  Cross-validation  of  an  experimental  pilot  selection  and  classification  test 
battery.  Paper  presented  at  the  30th  Annual  Military  Testing  Association  Conference, 
Arlington,  VA. 

Carretta,  T.  R.  (1988).  Relationship  of  encoding  speed  and  memory  tests  to  flight  training 
perfonnance.  Brooks  Air  Force  Base,  TX:  Air  Force  Human  Resources  Laboratory. 

The  demands  on  the  cognitive/perceptual  abilities  of  military  pilots  have  increased 
steadily  as  aircraft  have  become  more  sophisticated.  The  ability  to  encode  and  classify  signals 
and  to  retrieve  information  from  short-tenn  memory  are  two  of  the  several  cognitive/perceptual 
abilities  that  have  been  linked  to  flying  performance.  Two  tests,  Encoding  Speed  (encoding  and 
classification  ability)  and  Immediate/Delayed  Memory  (short-term  memory  retrieval),  were 
administered  to  2,219  United  States  Air  Force  pilot  candidates  prior  to  entry  into  Undergraduate 
Pilot  Training  (UPT).  Perfonnance  on  the  Encoding  Speed  test  was  related  to  successful 
completion  of  UPT,  in-flight  performance  measures,  and  advanced  training  assignment. 

However,  scores  on  the  Immediate/Delayed  memory  test  were  not  related  to  training 
perfonnance.  Pilot  candidates  who  made  quick  on  accurate  responses  on  the  Encoding  Speed  test 
were  more  likely  to  perform  well  on  in-flight  perfonnance  measures  and  be  recommended  for 
post-UPT  training  in  a  fast-jet  (Fighter-Attack-Reconnaissance)  aircraft.  Implications  for  pilot 
selection  and  classification  are  discussed. 

Carretta,  T.  R.  (1988).  USAF pilot  selection  and  classification  systems.  Paper  presented  at  the 
Psychology  in  the  Department  of  Defense  Conference. 

Carretta,  T.  R.  (1989).  Recent  Trends  in  USAF  Pilot  Selection  and  Classification  Research. 

Paper  presented  at  the  3 1st  Annual  Military  Testing  Association  Conference,  San 
Antonio,  TX. 

Carretta,  T.  R.  (1989).  USAF  pilot  selection  and  classification  systems.  Aviation,  Space,  and 
Environmental  Medicine,  60(1),  46-49. 

The  purpose  of  this  study  was  twofold:  (1)  to  identify  research  methodologies  (i.e.,  the 
Basic  Attributes  Test;  BAT)  that  add  to  the  predictive  validity  of  currently  used  pilot  selection 
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procedures;  and  (2)  to  detennine  how  accurately  the  recommendations  made  by  the  Advanced 
Training  Recommendation  Board  (ATRB;  fighter/non-fighter)  could  be  duplicated  without  using 
flight  training  perfonnance  data.  Four  hundred  seventy-eight  USAF  officer  candidates  from  the 
AFROTC  and  OTS  who  had  been  tested  on  the  BAT  participated.  Subjects  had  already  been 
chosen  for  Undergraduate  Pilot  Training  (UPT)  based  on  their  Air  Force  Officer  Qualifying  Test 
(AFOQT)  scores.  The  AFOQT  is  a  paper  and  pencil  battery  that  consists  of  16  subtests  and 
produces  five  composite  scores  and  the  BAT  consists  of  12  computer-administered  tests  that 
measure  psychomotor  skills  as  well  as  a  variety  of  cognitive  abilities,  perceptual  abilities, 
personality  and  attitudinal  characteristics.  Three  regression  models  were  evaluated  against  UPT 
final  outcome  and  ATRB  recommendations:  (1)  Model  I  included  AFOQT  Pilot  and  Navigator- 
Technical  composite  percentile  scores  along  with  the  number  of  times  the  AFOQT  was  taken  by 
the  subject;  (2)  Model  1 1  included  scores  from  the  BAT  subtests;  and  (3)  Model  III  combined 
the  first  two  models.  Results  showed  that  Model  I  was  significantly  related  to  both  UPT  (R  =  .17, 
p  <  .01)  and  ATRB  (R  =  .17,  p  <  .05).  Subjects  who  took  the  AFOQT  only  once  were  more 
likely  to  complete  UPT  successfully  and  to  be  recommended  for  follow-on  training  with  fighter 
aircraft  (FAR).  The  results  for  Model  II  showed  that  of  the  BAT  tests,  the  two  psychomotor 
skills  tests  demonstrated  the  strongest  relationship  to  UPT  (R  =  .26,  p  <  .01),  however,  they  were 
only  marginally  related  to  ATRB  (R  =  .  16,  p  <  .  10).  The  cognitive/perceptual  abilities  subtests 
were  also  significantly  related  to  UPT  and  ATRB.  For  the  personality/attitudinal  subtests,  results 
showed  that  those  subjects  who  were  more  cautious  on  the  test  of  self-confidence  (Self-crediting 
Word  Knowledge)  and  chose  fewer  high  risk  activities  were  more  likely  to  complete  UPT,  but 
these  tests  were  not  related  to  ATRB.  Finally,  the  results  for  Model  III  showed  the  strongest 
relationships  to  the  criteria  (UPT,  R  =  .50,  p  <  .01 ;  ATRB,  R  =  .44,  p  <  .05),  but  some  of  the 
variables  did  not  contribute  at  all.  Thus,  stepwise  regression  was  used  to  develop  a  simpler 
model.  The  AFOQT  scores  were  entered  first,  followed  by  the  remaining  39  variables.  The  final 
model  contained  1 1  variables  from  8  different  tests.  These  variables  included  the  AFOQT,  both 
psychomotor  tests,  3  of  the  cognitive  perceptual  abilities  tests  (Encoding  Speed,  Item 
Recognition  and  Time  Sharing)  and  2  of  the  personality/attitudinal  tests  (S-CWK,  All)  (R  =  .31, 
p  <  .01).  The  author  recommends  using  AFOQT  and  BAT  scores  to  both  classify  and  select 
students  for  UPT  and  advanced  flight  training. 

Carretta,  T.  R.  (1990).  Basic  Attributes  Test  (BAT):  A  Preliminary  Comparison  Between 
Reserve  Officer  Training  Corps  (ROTC)  and  Officer  Training  School  (OCS)  Pilot 
Candidates.  Brooks  AFB,  TX:  Air  Force  Human  Resources  Laboratory. 

The  Basic  Attributes  Test  (BAT)  battery  is  a  set  of  computer-administered  personnel  tests 
designed  to  assess  a  broad  range  of  attributes  believed  to  be  related  to  flying  training 
perfonnance.  The  original  battery  consisted  of  15  tests  that  measured  psychomotor  coordination, 
cognitive  and  perceptual  abilities,  and  personality  and  attitudinal  characteristics.  This  report 
focuses  on  the  development  of  interim  score  profiles  for  eight  of  the  BAT  tests  for  Reserve 
Officer  Training  Corps  (ROTC)  and  Officer  Training  School  (OTS)  pilot  candidates. 
Comparisons  between  the  two  groups  indicate  that  although  the  OTS  group  consistently  scored 
higher  on  the  Air  Force  Officer  Qualifying  Test  (AFOQT)  than  did  the  ROTC  group,  the  two 
groups  scored  very  similarly  on  the  BAT  battery.  A  factor  analysis  was  performed  to  provide 
insight  into  the  ability  domains  assessed  by  the  BAT  battery.  The  six  factors  that  emerged 
suggest  that  the  eight  tests  are  fairly  independent.  Finally,  research  regarding  the  utility  of  the 
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BAT  battery  for  pilot  selection  and  classification  is  reviewed  briefly  and  suggestions  are  made 
regarding  future  development  of  the  test  battery. 

Carretta,  T.  R.  (1990).  Cross-Validation  of  Experimental  USAF  Pilot  Training  Performance 
Models.  Brooks  AFB,  TX:  Air  Force  Human  Resources  Faboratory. 

A  series  of  studies  have  indicated  that  individual  differences  in  hand-eye  coordination, 
information  processing  ability,  personality  and  attitudes  are  related  to  USAF  pilot  training 
perfonnance.  The  current  investigation  was  designed  to  cross-validate  these  results.  Eight 
hundred  eighty-five  (885)  USAF  Undergraduate  Pilot  Training  (UPT)  students  were  divided 
randomly  into  two  groups.  Pilot  selection  models  that  used  a  combination  of  Air  Force  Officer 
Qualifying  Test  (AFOQT)  and  Basic  Attributes  Test  (BAT)  battery  scores  were  developed 
independently  for  each  group  and  then  cross-validated  with  the  other  group.  In  the  model 
development  phase,  subjects  with  good  hand-eye  coordination  who  made  quick  decisions  were 
more  likely  to  complete  UPT  successfully  in  both  groups.  Although  there  was  some  reduction  in 
the  validity  coefficients  in  the  crocs-validation  phase,  the  selection  models  were  related 
significantly  to  UPT  final  outcome  in  both  groups.  These  results  suggest  that  the  AFOQT/BAT 
pilot  selection  models  are  sufficiently  robust  to  be  used  as  adjuncts  to  operational  USAF  pilot 
trainee  selection  procedures. 

Carretta,  T.  R.  (1991).  Comparison  of  Experimental  U.S.  Air  Force  and  Euro-NATO  Pilot 
Candidate  Selection  Test  Batteries.  Brooks  AFB,  TX:  Annstrong  Faboratory. 

Air  Force  personnel  from  several  countries  currently  are  evaluating  computerized  test 
batteries  as  an  adjunct  to  current  pilot  candidate  selection  procedures.  This  paper  describes  and 
compares  proposed  U.S.  Air  Force  (USAF)  and  Euro-NATO  Aircrew  Selection  Working  Group 
(ACSWG)  pilot  candidate  selection  test  batteries.  A  validation  strategy  for  the  ACSWG  test 
battery  is  described  that  focuses  on  test  item  analyses  (e.g.,  evaluating  internal  consistency), 
evaluation  of  test  scoring  procedures,  evaluation  of  test  battery  factor  structure,  and  evaluation  of 
test  scores  against  training  perfonnance  criteria. 

Carretta,  T.  R.  (1991).  Short-tenn  test-retest  reliability  of  an  experimental  version  of  the  BAT: 
AF  Technical  Report  -1991-0001. 

Carretta,  T.  R.  (1992).  Predicting  pilot  training  perfonnance:  Does  the  criterion  make  a 
difference?  Brooks  Air  Force  Base,  TX:  Armstrong  Faboratory. 

The  purpose  of  this  study  was  to  examine  different  procedures  for  generating 
perfonnance  criteria  in  order  to:  (a)  reflect  the  relative  quality  of  USAF  pilot  candidates  based  on 
flying  performance  scores  and  academic  grades;  and  (b)  evaluate  the  utility  of  these  criteria  for 
improving  the  understanding  of  the  relationship  between  selection  test  scores  and  training 
perfonnance.  Seven  hundred  fifty- five  USAF  students  between  the  ages  of  21  and  31  years  old 
who  were  completing  Undergraduate  Pilot  Training  (UPT)  participated.  Each  subject  had  been 
administered  the  Air  Force  Officer  Qualifying  Test  (AFOQT)  and  the  Basic  Attributes  Test 
(BAT)  prior  to  entry  into  UPT  (subjects  had  already  been  chosen,  in  part,  on  the  basis  of  their 
AFOQT  scores).  The  AFOQT  battery  consists  of  16  subtests  that  assessed  5  ability  domains: 
verbal,  quantitative,  spatial,  perceptual  speed  and  aircrew  interests/aptitude.  Fourteen  of  the  16 
subtests  were  used  to  compute  the  Pilot  and  Navigator-Technical  composite  scores  used  in  the 
selection  of  pilot  candidates.  The  BAT  consists  of  8  computerized  tests  that  assessed  individual 
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differences  in  psychomotor  coordination  (rotary  pursuit,  stick  and  rudder,  compensatory 
tracking),  information  processing  ability  (reasoning,  spatial  transformation,  short -tenn  memory, 
perceptual  speed),  personality  (self-confidence)  and  attitudes  toward  risk-taking.  A  variety  of 
perfonnance  criteria  were  examined:  (1)  UPT  final  outcome  (pass/fail);  (2)  academic  grades;  (3) 
daily  flying  grades;  (4)  check  flight  grades;  and  (5)  number  of  flying  hours.  The  Air  Training 
Command  (ATC)  uses  a  weighted  evaluation  score  based  on  three  phases:  Phase  I  (academic), 
Phase  II  (T-37,  flying  perfonnance  grades),  and  Phase  III  (T-38,  flying  performance  grades). 
Several  different  equations  were  developed  each  dealing  with  the  eliminees  in  a  different  way. 
Generally  speaking,  the  rankling  of  the  candidates  was  nearly  identical  for  equations  based  on  all 
of  the  criteria.  For  pilot  training  candidates,  the  criterion  used  did  not  make  a  difference  as  to 
who  would  have  been  selected.  Additionally,  alternative  criteria  demonstrated  little  utility  for 
understanding  the  relationship  between  preselection  personnel  test  scores  and  training 
perfonnance.  However,  the  rankings  generated  from  the  weighted  evaluation  scores  were  shown 
to  be  closely  related  to  advanced  training  recommendations  (fighter  vs.  nonfighter  aircraft). 

Carretta,  T.  R.  (1992).  Recent  developments  in  U.S.  Air  Force  pilot  selection  and  classification. 

Aviation,  Space,  and  Environmental  Medicine,  63(12),  1112-1114. 

This  article  discusses  the  implementation  of  a  new  system  for  classifying  pilots.  At  the 
time  this  article  was  written,  Air  Force  pilots  were  selected  using  a  positively  weighted 
composite  of  the  following  measures:  the  AFOQT  pilot  composite,  composite  psychomotor 
response  speed  scores  from  Mental  Rotation  (spatial  transformation)  and  Item  Recognition 
(short-term  memory),  tracking  difficulty  from  Time  Sharing,  response  speed  and  response  choice 
from  Activities  Interest  Inventory  (attitudes  toward  risk)  and  previous  flying  experience.  The  Air 
Force  had  proposed  to  implement  the  Pilot  Selection  and  Classification  System  (PSACS)  which 
would  change  the  process  by  which  pilot  candidates  are  selected  and  classified.  The  first  plan 
was  to  replace  Undergraduate  Pilot  Training  (UPT)  with  Specialized  Undergraduate  Pilot 
Training  (SUPT),  which  would  classify  pilot  candidates  into  one  of  four  major  weapon  systems 
categories  (bomber,  fighter,  tanker  or  transport  aircraft)  using  the  AFOQT  and  the  BAT.  This 
plan  was  revised  and  classification  into  SUPT  was  to  occur  at  the  completion  of  T-37  training 
and  be  based  on  T-37  flying  and  academic  perfonnance,  pilot  candidate  preferences  and  aircraft 
availability.  The  new  plan  included  the  Pilot  Candidate  Selection  Method  (PCSM),  which 
includes  the  Pilot  and  Navigator-Technical  AFOQT  composites,  BAT  psychomotor  scores, 
biographical  information,  infonnation  processing  and  personality  measures.  In  a  sample  of  1,1 12 
U.S.  Air  Force  UPT  students,  the  regression  of  these  scores  onto  UPT  final  outcome  (pass/fail) 
was  .3 1 .  The  author  described  this  as  a  significant  improvement  in  operational  suitability.  This 
system  was  scheduled  to  be  operationally  implemented  by  1992. 

Carretta,  T.  R.  (1992).  Short-tenn  retest  reliability  of  an  experimental  U.S.  Air  Force  pilot 

candidate  selection  test  battery.  International  Journal  of  Aviation  Psvchology,  2(3),  161- 

173. 

Two  hundred  forty-seven  U.S.  Air  Force  pilot  candidates  commissioned  through  the  Air 
Force  Reserve  Officer  Training  Corps  were  tested  on  an  experimental  form  of  the  Basic 
Attributes  Test  (BAT)  battery  twice  on  consecutive  days  at  the  beginning  of  a  flight  screening 
program.  The  purpose  of  this  study  was  to  examine  the  short-term  retest  reliability  of  the  BAT 
battery.  There  was  a  moderate  correlation  between  subjects'  first  and  second  administration  test 
composites  (Pearson  r  =  .56,  Spearman  r  =  .55).  The  magnitude  of  the  retest  correlations  may 
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have  been  underestimated  due  to  reduced  test  length  and  preselection  of  subjects  on  operational 
selection  instruments.  Implications  for  an  operational  retest  policy  and  for  a  planned 
measurement  and  metric  equivalency  study  are  discussed. 

Carretta,  T.  R.  (1992).  Understanding  the  relations  between  selection  factors  and  pilot  training 
perfonnance:  Does  the  criterion  make  a  difference?  International  Journal  of  Aviation 
Psychology,  2,  95-106. 

Carretta,  T.  R.  (1995).  What  is  Measured  and  What  is  Predictive  in  USAF  Pilot  Selection  Tests? 
Paper  presented  at  the  37th  Annual  International  Military  Testing  Association 
Conference,  Toronto,  ON,  Canada. 

Carretta,  T.  R.  (1996).  Air  Force  Officer  Qualifying  Test  Retest  Performance.  Paper  presented  at 
the  38th  Annual  International  Military  Testing  Association  Conference,  San  Antonio, 

TX. 

The  Air  Force  Officer  Qualifying  Test  (AFOQT)  is  a  multiple  aptitude  battery  used  to 
select  applicants  for  U.  S.  Air  Force  (USAF)  officer  commissioning  programs  and  to  classify 
commissioned  officers  into  aircrew  training  programs.  Its  factor  structure  has  been  studied 
(Carretta  &  Ree,  1996),  it  has  been  validated  for  pilot  and  navigator  training  (Arth,  Steuck, 
Sorrentino,  &  Burke,  1990;  Carretta  &  Ree,  1995a;  Olea  &  Ree,  1994),  and  group  differences 
have  been  examined  (Carretta,  in  press;  Carretta  &  Ree,  1995b;  Roberts  &  Skinner,  1995). 
Current  Air  Force  policy  allows  applicants  to  test  twice  on  the  AFOQT  (one  retest).  The 
minimum  retest  interval  is  six  months,  but  a  retest  may  occur  after  several  years.  Additional 
retests  can  be  and  are  granted,  but  require  a  waiver.  Only  the  latest  scores  are  reported  to  officer 
and  aircrew  selection  boards  and  the  boards  are  not  informed  whether  the  score  is  a  retest. 
Although  the  current  form  (or  its  equivalent)  of  the  AFOQT  has  been  in  use  since  198  1,  little 
research  has  been  done  to  examine  its  retest  characteristics  (i.e.,  score  changes,  reliability, 
validity).  Arth  (1986)  examined  score  changes  and  retest  reliability  for  the  operational 
composites  in  a  sample  of  2,246  USAF  officer  applicants.  He  observed  that  retesters‘  first-test 
scores  were  lower  than  those  who  tested  only  once.  Arth  also  observed  score  gains  for  all 
composites  and  retest  reliabilities  between  .775  and  .880.  However,  he  did  not  examine  score 
changes  or  retest  reliability  for  the  16  AFOQT  tests,  nor  did  he  examine  the  predictive  validity  of 
first  versus  retest  scores  for  pilot  trainees.  The  purpose  of  this  study  was  to  examine  retest  mean 
score  perfonnance  and  retest  reliability  on  the  AFOQT  composites  and  tests  and  to  evaluate 
alternative  methods  for  handling  retest  scores.  Estimating  the  stability  of  test  perfonnance  over 
time  is  important  because  it  establishes  an  upper  limit  on  the  amount  of  agreement  that  can  be 
expected  on  a  retest  and  may  provide  insight  about  the  interpretation  of  retest  scores  relative  to 
first-test  scores.  Examining  the  predictiveness  of  first  and  retest  scores  may  help  to  infonn  policy 
in  the  use  of  retest  scores  for  pilot  selection. 

Carretta,  T.  R.,  Perry,  D.C.  and  Ree,  M.J.  (1996).  Prediction  of  situational  awareness  in  F-15 
pilots .  International  Journal  of  Aviation  Psychology,  6(1),  12-41. 

Carretta,  T.  R.  (1996).  Preliminary  validation  of  several  US  Air  Force  computer-based  cognitive 
pilot  selection  tests.  Brooks  Air  Force  Base,  TX:  Armstrong  Laboratory. 
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Carretta,  T.  R.  (1997).  Group  differences  on  U.S.  Air  Force  pilot  selection  tests.  Brooks  Air 
Force  Base,  TX:  Armstrong  Laboratory. 

Carretta,  T.  R.  (1997).  Group  differences  on  US  Air  Force  Pilot  Selection  Tests.  International 
Journal  of  Selection  and  Assessment,  5(2),  115-127. 

Carretta,  T.  R.  (1997).  Male-female  perfonnance  on  U.S.  Air  Force  pilot  selection  tests. 

Aviation,  Space,  and  Environmental  Medicine,  68(9),  818-823. 

Summarizes  several  studies  of  sex-differences  in  responses  on  Air  Force  pilot  selection 
tests  and  in  training  performance.  Reviews  the  predictive  utilities  of  selection  instruments  and 
their  ability  structures  and  contribution  of  flying  knowledge  to  training  perfonnance. 
Confinnatory  factor  analyses  indicate  that  the  same  factors  are  measured  for  both  sexes,  although 
scores  may  be  different.  No  evidence  of  predictive  bias  was  found. 

Carretta,  T.  R.  (2000).  U.S.  Air  Force  pilot  selection  and  training  methods.  Aviation,  Space,  and 
Environmental  Medicine,  71(9),  950-956. 

Changes  in  U.S.  Air  Force  (USAF)  pilot  selection  and  training  procedures  have  occurred 
in  the  last  5  years,  including  utilization  of  computer-based  testing  techniques  to  measure  pilot 
aptitude.  Training  procedures  have  changed  to  provide  more  specialized  training  earlier  in  the 
training  cycle.  A  recent  study  suggests  that  the  information  derived  from  testing  is  often  ignored 
by  pilot  candidate  selection  boards.  The  largest  sources  of  USAF  pilot  trainees  rely  on  measures 
of  officership  for  selection  decisions.  USAF  pilot  selection  decisions  could  be  improved  by 
making  better  use  of  personnel  attribute  data.  Further  improvements  could  be  gained  from  a 
structured  selection  interview  and  measures  of  personality. 

Carretta,  T.  R.  (2000).  U.S.  Air  Force  Pilot  Selection  and  Training  Methods.  Wright-Patterson 
Air  Force  Base,  TX:  Air  Force  Research  Laboratories. 

Carretta,  T.  R.  (2002).  Common  military  pilot  selection  practices.  Gateway,  XIII(\),  1-4. 

Carretta,  T.  R.  (2005).  Development  and  Validation  of  the  Test  of  Basic  Aviation  Skills  (TBAS). 

In  1993,  the  Pilot  Candidate  Selection  Method  (PCSM)  was  operationally  implemented 
as  an  adjunct  to  US  Air  Force  pilot  training  selection  methods.  PCSM  combined  the  Air  Force 
Officer  Qualifying  Test  (AFOQT)  Pilot  composite  scores  from  the  Basic  Attributes  Test  (BAT) 
and  a  measure  of  prior  flying  experience  in  a  regression-weighted  pilot  aptitude  composite.  Since 
1993,  neither  the  BAT  hardware  nor  software  have  been  updated.  As  with  all  aptitude  tests,  it  is 
desirable  to  update  test  content  at  regular  intervals  to  keep  it  current  and  avoid  potential 
problems  such  as  test  compromise.  In  the  case  of  computer-based  tests  such  as  the  BAT,  it  is  also 
desirable  to  update  test  hardware  and  software  to  avoid  problems  associated  with  normal  wear  to 
the  system  (e.g.,  calibration  of  the  control  sticks,  functioning  of  input  devices)  and  to  take 
advantage  of  advances  in  computer  hardware  and  software.  The  Test  of  Basic  Aviation  Skills 
(TBAS)  was  developed  as  a  candidates  BAT  replacement  test  in  the  PCSM  equation.  The 
purpose  of  this  report  is  to  document  the  TBAS  development  process  and  report  results  of  a 
study  of  its  validity  and  incremental  validity  versus  measures  of  pilot  training  performance  when 
used  with  other  operational  measures  of  pilot  aptitude  (i.e.,  AFOQT),  prior  flying  experience). 
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Carretta,  T.  R.  (2006).  Evaluation  of  Adverse  Impact  for  US  Air  Force  Officer  and  Aircrew 

Selection  Tests.  Wright-Patterson  Air  Force  Base,  OH:  Air  Force  Research  Faboratory. 
Adverse  impact  issues  have  posed  a  challenge  to  military  personnel  selection.  The 
purpose  of  the  current  study  was  to  examine  group  differences  in  performance  on  tests  used  to 
qualify  applicants  for  US  Air  Force  officer  commissioning  and  aircrew  training  programs.  In 
particular,  the  impact  of  raising  minimum  qualifying  scores  on  selection  ratios  for  majority  and 
minority  groups  was  examined.  Results  indicated  that  strict  application  of  the  current  minimum 
qualifying  standards,  along  with  top-down  selection  of  qualified  applicants,  would  lead  to 
adverse  impact  for  females  and  racial/ethnic  minorities  for  both  officer  commissioning  and 
aircrew  training  programs.  Future  test  development  should  focus  on  the  identification  of  tests 
that  preserve  the  predictive  validity  of  USAF  personnel  selection  tests  while  minimizing 
subgroup  differences.  Reduction  of  adverse  impact  across  all  subgroups  is  a  challenging  issue. 
Sometimes  changes  in  test  content  or  the  addition  of  a  new  test  may  reduce  adverse  impact  for 
one  subgroup  but  worsen  it  for  another.  Setting  low  minimum  qualifying  scores  allows  a  greater 
range  of  applicants  to  be  considered  for  training  or  job  opportunities,  but  may  adversely  affect 
organizational  performance  (i.e.,  increase  training  requirements,  reduce  job  performance). 
Minimum  qualifying  scores  should  be  based  on  empirical  research  (e.g.,  job  analysis)  identifying 
the  ability  requirements  for  successful  perfonnance  of  the  jobs  being  targeted. 

Carretta,  T.  R.,  &  Doub,  T.  W.  (1998).  Group  differences  in  the  role  of  g  and  prior  job 

knowledge  in  the  acquisition  of  subsequent  job  knowledge.  Brooks  Air  Force  Base,  TX: 
Air  Force  Research  Faboratory. 

Carretta,  T.  R.,  &  King,  R.  E.  (2008).  Improved  military  air  traffic  controller  selection  methods 
as  measured  by  subsequent  training  perfonnance.  Aviation,  Space,  and  Environmental 
Medicine,  79(1),  36-43. 

INTRODUCTION:  Over  the  past  decade,  the  U.S.  military  has  conducted  several  studies 
to  evaluate  determinants  of  enlisted  air  traffic  controller  (ATC)  performance.  Research  has 
focused  on  validation  of  the  Anned  Services  Vocational  Aptitude  Battery  (ASVAB)  and  has 
shown  it  to  be  a  good  predictor  of  training  performance.  Despite  this,  enlisted  ATC  training  and 
post-training  attrition  is  higher  than  desirable,  prompting  interest  in  alternate  selection  methods 
to  augment  current  procedures.  The  current  study  examined  the  utility  of  the  FAA  Air  Traffic 
Selection  and  Training  (AT-SAT)  battery  for  incrementing  the  predictiveness  of  the  ASVAB 
versus  several  enlisted  ATC  training  criteria.  METHOD:  Subjects  were  448  USAF  enlisted  ATC 
students  who  were  administered  the  ASVAB  and  FAA  AT-SAT  subtests  and  subsequently 
graduated  or  were  eliminated  from  apprentice-level  training.  Training  criteria  were  a 
dichotomous  graduation/elimination  training  score,  average  ATC  fundamentals  course  score,  and 
FAA  certified  tower  operator  test  score.  RESUFTS:  Results  confirmed  the  predictive  validity  of 
the  ASVAB  and  showed  that  one  of  the  AT-SAT  subtests  resembling  a  low-fidelity  ATC  work 
sample  significantly  improved  prediction  of  training  performance  beyond  the  ASVAB  alone. 
DISCUSSION:  Results  suggested  training  attrition  could  be  reduced  by  raising  the  current 
ASVAB  minimum  qualifying  score.  However,  this  approach  may  make  it  difficult  to  identify 
sufficient  numbers  of  trainees  and  lead  to  adverse  impact.  Although  the  AT-SAT  ATC  work 
sample  subtest  showed  incremental  validity  to  the  ASVAB,  its  length  (95  min)  may  be 
problematic  in  operational  testing.  Recommendations  are  made  for  additional  studies  to  address 
issues  affecting  operational  implementation. 
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Carretta,  T.  R.,  &  Ree,  M.  J.  (1993).  Basic  Attributes  Test  (BAT):  Operational  pre¬ 
implementation  analysis  and  score  equating.  Brooks  Air  Force  Base,  TX:  Armstrong 
Laboratory. 

Carretta,  T.  R.,  &  Ree,  M.  J.  (1993).  Basic  Attributes  Test  (BAT):  Psychometric  equating  of  a 
computer-based  test.  International  Journal  of  Aviation  Psychology,  3,  189-201. 

Carretta,  T.  R.,  &  Ree,  M.  J.  (1993).  Pilot  Candidate  Selection  Method  (PCSM):  What  Makes  It 
Work?  Brooks  AFB,  TX:  Armstrong  Laboratory. 

A  sample  of  678  Air  Force  pilot  training  candidates  were  tested  with  a  paper-and  pencil 
aptitude  battery  and  computer-administered  tests  of  psychomotor  skills,  infonnation  processing, 
and  attitude  toward  risk.  A  self  report  of  flying  experience  was  also  collected.  These  data  were 
used  in  regression  analyses  to  determine  which  variables  provided  the  best  prediction  of  two 
flying  criteria,  passing-failing  flying  training  and  class  ranking  at  the  end  of  flying  training.  The 
paper-and-pencil  tests  were  found  to  be  the  best  predictors.  The  measures  of  flying  experience, 
psychomotor  skills,  and  altitude  toward  risk  incremented  the  prediction  of  the  criteria. 
Infonnation  processing  was  not  found  to  be  incremental  to  the  other  variables  in  the  prediction  of 
the  criteria. 

Carretta,  T.  R.,  &  Ree,  M.  J.  (1993).  Validity  of  the  Air  Force  Officer  Qualifying  Test  for 
predicting  pilot  training  performance.  Paper  presented  at  the  35th  Annual  Military 
Testing  Association  Conference,  Williamsburg,  VA. 

The  U.S.  Air  Force  has  used  the  same  fundamental  approach  for  the  selection  of  pilots  for 
over  35  years.  Included  among  the  selectors  is  the  Air  Force  Officer  Qualifying  Test  (AFOQT) 
which  is  comprised  of  16  tests.  Although  the  AFOQT  has  been  used  for  officer  commissioning 
and  aircrew  selection  since  1957,  few  studies  have  examined  its  validity  for  predicting  pilot 
training  perfonnance  since  1966.  The  current  study  validated  the  AFOQT  tests  for  five  pilot 
training  criteria.  Subjects  were  7,563  men  and  women  selected  for  pilot  training  on  the  basis  of 
educational  attainment,  academic  major,  and  AFOQT  scores.  Criterion  variables  included  daily 
flying  grades  and  check  flight  grades  in  subsonic  and  transonic  aircraft,  and  overall  academic 
perfonnance  in  the  53  week  pilot  training  course.  The  criteria  showed  low  to  moderate 
conelations  with  each  other.  Test  validities  were  presented  in  range-restricted  fonn  and  were 
conected  for  multivariate  range  restriction.  The  Arithmetic  Reasoning  test  was  most  predictive 
of  academic  success.  The  Aviation  Information  and  Instrument  Comprehension  tests  were  most 
predictive  of  daily  and  check  flights  in  the  initial  jet  aircraft.  The  Scale  Reading  test  was  most 
predictive  for  daily  and  check  flights  in  the  advanced  training  aircraft.  The  average  validity  of 
the  tests  in  the  operational  composite  used  to  select  pilots  was  found  to  be  .19  and  the  average  of 
the  eight  most  valid  tests  for  pilot  selection  was  .2 1 . 

Carretta,  T.  R.,  &  Ree,  M.  J.  (1994).  Pilot-Candidate  Selection  Method:  Sources  of  Validity. 
International  Journal  of  Aviation  Psychology,  4(2),  103-117. 

Six  hundred  seventy-eight  Air  Force  pilot  training  candidates  were  tested  with  a  paper- 
and-pencil  aptitude  battery  and  computer-administered  tests  of  psychomotor  skills,  information 
processing,  and  attitude  toward  risk.  A  self-report  of  flying  experience  was  also  collected.  These 
data  were  used  in  regression  analyses  to  determine  which  variables  provided  the  best  prediction 
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of  two  flying  criteria:  pass-fail  flying  training,  and  class  rank  at  the  end  of  flying  training.  The 
paper-and-pencil  tests  were  found  to  be  the  best  predictors.  The  measures  of  flying  experience, 
psychomotor  skills,  and  attitude  toward  risk  incremented  the  prediction  of  the  criteria  above  the 
prediction  provided  by  the  paper-and-pencil  tests  by  23%.  Computer-administered  information¬ 
processing  measures  were  not  found  to  be  incremental  to  the  other  variables  in  the  prediction  of 
the  criteria. 

Carretta,  T.  R.,  &  Ree,  M.  J.  (1995).  Air  force  officer  qualifying  test  validity  for  predicting  pilot 

training  performance.  Journal  of  Business  and  Psychology,  9(4),  379-388. 

The  AFOQT  was  validated  for  the  prediction  of  pilot  training  criteria.  Subjects  were 
7,563  men  and  women  selected  for  pilot  training  on  the  basis  of  educational  attainment  and 
AFOQT  scores.  Criterion  variables  included  daily  flight  training  grades,  check  flight  grades  in 
subsonic  and  transonic  aircraft,  and  overall  academic  performance  in  the  53  week  pilot  training 
course.  Test  validities  were  presented  as  observed,  corrected  for  multivariate  range  restriction, 
and  corrected  for  multivariate  range  restriction  and  unreliability.  The  Aviation  Information  and 
Instrument  Comprehension  tests,  measures  of  job  knowledge,  were  most  predictive  of  daily  and 
check  flights  in  the  initial  subsonic  jet  aircraft.  This  reflects  the  relative  greater  importance  of 
prior  job  knowledge  early  in  training.  The  Scale  Reading  test,  a  measure  of  perceptual  speed, 
was  most  predictive  for  daily  and  check  flights  in  the  advanced  transonic  training  aircraft.  The 
Arithmetic  Reasoning  test,  a  good  measure  of  general  cognitive  ability,  was  most  predictive  of 
aeronautics  in  ground  school.  The  development  of  an  improved  pilot  selection  composite  is 
suggested  by  the  results  of  the  validity  analyses. 

Carretta,  T.  R.,  &  Ree,  M.  J.  (1996).  Factor  structure  of  the  Air  Force  Officer  Qualifying  Test: 

Analysis  and  Comparison.  Military  Psychology,  5(1),  29-42. 

The  Air  Force  Officer  Qualifying  Test  (AFOQT)  is  used  to  qualify  men  and  women  for 
commissions  in  the  Air  Force,  classify  them  for  pilot  and  navigator  jobs,  and  award  Reserve 
Officer  Training  Corps  (ROTC)  scholarships.  Despite  more  than  three  decades  of  use,  little 
published  literature  exists  outside  of  Air  Force  technical  reports,  which  do  not  receive  wide 
distribution.  One  of  the  most  important  details  about  a  test  battery  is  which  factors  it  measures. 
To  determine  this,  several  factor  models  were  tested  with  structural  equations.  Most  of  the 
models  were  hierarchical  with  general  cognitive  ability  (g)  as  the  highest  factor.  A  model  with 
hierarchical  g  and  the  five  lower  order  factors  of  verbal,  math,  spatial,  aircrew,  and  perceptual 
speed  fit  the  data  best.  The  factor  structure  of  the  AFOQT  was  compared  to  the  factor  structure 
of  the  Armed  Services  Vocational  Aptitude  Battery  (ASVAB),  the  enlistment  qualification  test 
battery.  The  AFOQT  was  found  to  contain  a  greater  number  of  factors  than  did  the  ASVAB. 
Given  the  confirmed  AFOQT  factor  structure,  four  methods  of  increasing  its  validity  are 
proposed  and  discussed.  These  methods  are  increasing  reliability  of  the  tests,  increasing  the  g 
saturation,  adding  job  knowledge  tests,  and  adding  additional  valid  factors. 

Carretta,  T.  R.,  &  Ree,  M.  J.  (1996).  US  Air  Force  pilot  selection  tests:  What  is  measured  and 

what  is  predictive?  Aviation,  Space,  and  Environmental  Medicine,  67(3),  279-283. 

Carretta,  T.  R.,  &  Ree,  M.  J.  (1997).  The  best  retest  is  the  average:  Findings  and  implications. 

Brooks  Air  Force  Base,  TX:  Armstrong  Laboratory. 
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Carretta,  T.  R.,  &  Ree,  M.  J.  (1997).  Expanding  the  nexus  of  cognitive  and  pyschomotor 
abilities.  International  Journal  of  Selection  and  Assessment,  5(3),  149-157. 

A  study  was  conducted  to  expand  the  nexus  of  cognitive  and  psychomotor  abilities.  A 
cognitive  aptitude  battery  and  a  psychomotor  battery  were  administered  to  429  military  recruits. 
A  confirmatory  factor  analysis  yielded  higher-order  factors  of  general  cognitive  ability  (g)  and 
psychomotor/technical  knowledge  (PM/TK).  PM/TK  was  interpreted  as  Vernon's  (1969) 
practical  factor  (k:m).  In  the  joint  analysis  of  these  batteries,  g  and  PM/TK  each  accounted  for 
about  31%  of  the  common  variance.  No  residualized  lower-order  factor  accounted  for  more  than 
7%  PM/TK  influenced  a  broad  range  of  lower-order  psychomotor  factors.  The  first  practical 
implication  of  these  findings  is  that  psychomotor  tests  are  expected  to  be  at  least  generally 
interchangeable.  A  second  implication  is  that  the  incremental  validity  of  psychomotor  tests 
beyond  cognitive  tests  is  expected  to  be  small.  These  findings  should  help  guide  test  developers 
and  inform  personnel  selecting  agencies  regarding  the  expected  utility  of  psychomotor  tests. 

Carretta,  T.  R.,  &  Ree,  M.  J.  (1997).  Factor  Structures  of  the  Air  Force  Officer  Qualifying  Test: 
Analysis  and  Comparison.  Brooks  AFB,  TX:  United  States  Air  Force  Research 
Faboratory. 

Carretta,  T.  R.,  &  Ree,  M.  J.  (1997).  Male  and  female  causal  models  of  pilot  skill  acquisition:  A 
preliminary  evaluation.  Brooks  Air  Force  Base,  TX:  Annstrong  Faboratory. 

Carretta,  T.  R.,  &  Ree,  M.  J.  (1997).  Negligible  sex  differences  in  the  relation  of  cognitive  and 
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the  data,  the  method  for  synthesizing  the  performance  measures,  and  the  results  from  using  the 
measures  to  score  student  pilots. 
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BACKGROUND:  Attrition  of  students  from  aviation  training  is  a  serious  financial  and 
operational  concern  for  the  U.S.  Navy.  Each  late  stage  navy  aviator  training  failure  costs  the 
taxpayer  over  $1,000,000  and  ultimately  results  in  decreased  operational  readiness  of  the  fleet. 
Currently,  potential  aviators  are  selected  based  on  the  Aviation  Selection  Test  Battery  (ASTB), 
which  is  a  series  of  multiple-choice  tests  that  evaluate  basic  and  aviation-related  knowledge  and 
ability.  However,  the  ASTB  does  not  evaluate  a  person's  response  to  stress.  This  is  important 
because  operating  sophisticated  aircraft  demands  exceptional  perfonnance  and  causes  high 
psychological  stress.  Some  people  are  more  resistant  to  this  type  of  stress,  and  consequently 
better  able  to  cope  with  the  demands  of  naval  aviation,  than  others. 
METHODOLOGY/PRINCIPAL  FINDINGS:  Although  many  psychological  studies  have 
examined  psychological  stress  resistance  none  have  taken  advantage  of  the  human  genome 
sequence.  Here  we  use  high-throughput  -omic  biology  methods  and  a  novel  statistical  data 
nonnalization  method  to  identify  plasma  proteins  associated  with  human  perfonnance  under 
psychological  stress.  We  identified  proteins  involved  in  four  basic  physiological  processes: 
innate  immunity,  cardiac  function,  coagulation  and  plasma  lipid  physiology. 
CONCLUSIONS/SIGNIFICANCE:  The  proteins  identified  here  further  elucidate  the 
physiological  response  to  psychological  stress  and  suggest  a  hypothesis  that  stress-susceptible 
pilots  may  be  more  prone  to  shock.  This  work  also  provides  potential  biomarkers  for  screening 
humans  for  capability  of  superior  perfonnance  under  stress. 
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The  present  effort  examined  the  selection  process  used  for  Air  Force  Officer  Training 
School  (OTS)  candidates,  with  a  view  toward  identifying  and  validating  the  component 
variables.  In  addition,  the  predictive  validity  of  an  experimental  DTS  selection  algorithm  was 
examined.  Variables  which  were  most  highly  related  to  selection  decisions  were  examined  for 
their  relation  to  measures  of  performance  in  training  and  on  the  job.  Criterion  measures  included: 
perfonnance  in  OTS  (instructor  evaluations,  final  grade,  completion,  distinguished  graduate); 
technical  training  school  final  grade;  completion  of  Undergraduate  Pilot  Training;  completion  of 
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significantly  related  to  selection  outcome;  (b)  different  predictor  variables  are  related  to  selection 
for  different  occupational  specialties;  (c)  there  are  significant  differences  among  occupational 
specialties  as  to  the  extent  to  which  selection  decisions  are  predicted;  (d)  additional  variables  not 
examined  here  may  influence  selection  decisions  (e.g.,  narrative  infonnation  contained  in  the 
applicant  folder);  (e)  most  of  the  variables  recommended  by  USAF  Recruiting  Service  for  OTS 
selection  decisions  are  significantly  related  to  measures  of  perfonnance  in  training  and  on  the 
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laterality,  beginning  with  a  brief  discussion  of  the  research  methods  employed.  Aspects  of 
laterality,  including  vision,  audition,  tactile  perception,  spatial  ability,  and  language  are 
reviewed,  as  well  as  theories  of  cerebral  dominance  patterns.  The  handedness  literature  is 
examined,  with  attention  to  measurement,  theories  of  genesis,  sociocultural  factors,  and  sex 
differences.  There  are  many  postulated  correlates  of  human  laterality,  including  perfonnance, 
occupation,  emotions,  and  various  diseases.  References,  suggest  that  pilots  who  have  no  strong 
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standard  tests  of  spatial  ability.  Based  on  these  analyses,  infonnation-processing  models  have 
been  developed,  suggesting  that  subjects  work  through  a  sequence  of  component  mental 
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processes  (e.g.,  code,  transform,  match)  to  perform  spatial  test  items.  If  these  models  are  correct, 
then  response  latencies,  especially  estimates  of  component -process  durations,  may  be  the  best 
measures  of  spatial  ability.  By  contrast,  traditional  psychometric  analyses  of  these  tasks  have 
consistently  used  overall  accuracy  scores  as  measures  of  spatial  ability.  A  model  of  the 
relationship  between  traditional  accuracy  measures  of  spatial  ability  and  theoretically  based 
latency  measures  is  proposed.  In  this  model  overall  accuracy  and  mean  latency  are  viewed  as 
composite  scores  consisting  of  the  product  (accuracy)  or  sum  of  latency)  of  component-process 
parameters.  Three  experiments  investigated  the  relationship  between  spatial  accuracy  and  latency 
scores,  and  established  some  psychometric  properties  (reliability,  correlation  across  tests, 
predictive  validity)  of  various  measures.  While  accuracy  and  mean  latency  scores  each  proved  to 
be  reliable  and  consistent  across  different  tests,  the  two  measures  were  virtually  independent. 
Further  analyses  using  component  process  latency  scores  suggest  that  different  mental  processes 
influence  overall  accuracy  and  mean  latency.  One  hypothesis  consistent  with  the  data  is  that 
spatial  accuracy  scores  reflect  the  ability  to  accurately  code  a  pictorial  stimulus,  but  mean 
latency  scores  on  the  same  items  reflect  the  ability  to  mentally  transfonn  the  code.  Implications 
for  ability  testing  are  discussed. 
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There  has  been  a  psychologist  servicing  RAAF  Schools  of  Air  Navigation  and  Air  Traffic 
Control  since  1990.  The  psychologists  role  at  these  schools  is  to  assess  and  counsel  student 
problems,  teach  techniques  for  perfonnance  enhancement,  particularly  stress  management 
techniques,  provide  input  to  instructor  training  courses,  and  conduct  research  to  improve 
selection  and  training  effectiveness.  In  support  of  this  role,  students  have  been  routinely 
administered  various  personality  measures,  particularly  the  Myers  Briggs  Type  Indicator  (MBTI) 
and/or  a  Big  5  personality  questionnaire  (NEO-PI-R  or  NEO-FFI),  as  well  as  Niedeffer‘s  Test  of 
Attentional  and  Interpersonal  Styles  (TAIS)  and  the  Osipow  and  Spokane  Occupational  Stress 
Inventory  (OSI).  The  use  of  these  measures  in  teaching  students  strategies  for  maximising 
performance  is  discussed,  with  some  case  studies.  Descriptive  data  is  presented  for  various 
measures,  outlining  how  useful  these  are  in  predicting  training  outcomes. 
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Ellis,  S.  A.,  Moore,  J.  L.,  &  Dolgin,  D.  L.  (2001).  Aviator  personality  assessment :  Part  I — 
aeronautical  adaptability.  Paper  presented  at  the  Aerospace  Medical  Association 
Meeting,  Reno,  NV. 

Ellshaw,  C.  C.,  &  Abram,  C.  M.  (1997).  Personality  and  Met  Expectations  and  the  Prediction  of 
Voluntary  Wastage  Amongst  Officer  Cadets.  Paper  presented  at  the  39th  Annual 
International  Military  Testing  Association  Conference,  Sydney,  Australia. 

The  paper  examines  the  feasibility  of  improving  the  assessment  of  motivation  among 
potential  officer  candidates  at  the  Regular  Commissions  Board  (RCB).  There  are  three  central 
issues:  why  do  those  deemed  suitable  for  officer  entry  decide  to  leave  voluntarily  what  can  be 
done  to  predict  voluntary  wastage  what  other  interventions  are  open  to  the  organisation  to 
influence  the  pattern  of  withdrawal?  The  reasons  that  underlie  this  problem  are  complex, 
however,  recognising  what  influences  the  motivation  of  potential  officers  is  central  to  improving 
the  overall  selection  and  training  system.  Given  the  complexity  of  the  problem,  the  current  report 
has  been  based  on  an  extensive  and  detailed  investigation  of  available  research  and  has  used  a 
number  of  approaches  to  study  the  problem.  Currently,  a  significant  number  of  candidates 
withdrew  from  the  selection  process  between  RCB  Briefing  and  the  RCB  and  between  RCB  and 
entry  to  the  Royal  Military  Academy  Sandhurst  (RMAS).  Additionally,  between  10-12%  of 
RMAS  main  course  cadets  voluntarily  withdrew  from  training  (VWFT).  Voluntary  wastage  is 
likely  to  become  an  increasing  problem  in  the  light  of  demographic  trends,  increasing  recruiting 
targets  and  limits  on  recruiting  resources.  Considerable  value  exists  in  developing  measures 
specifically  designed  to  predict  voluntary  withdrawal.  The  study  comprised  an  examination  of 
exit  reports  and  a  large  scale  survey  of  605  officer  cadets.  The  analysis  of  training  records  was 
undertaken  to  examine  reasons  for  VWFT  amongst  young  officer  cadets.  The  survey  was 
targeted  at  various  cross-sections  of  RMAS  cadets.  The  survey  aimed  to  explore  a  wide  range  of 
theoretical  issues  of  potential  value  in  predicting  VWFT.  The  questionnaire  also  provided  the 
opportunity  to  trial  a  number  of  potential  personality  measures  (the  Trait-Self  Description  (T- 
SD)  inventory  and  the  Focus  of  Control  and  Self  efficiency  scale).  The  results  of  this  study 
strongly  reflect  the  importance  of  realistic  knowledge  and  expectations  about  initial  officer 
training  among  Army  applicants  and  the  role  of  personality  in  adapting  to  the  demands  of 
Sandhurst  life.  VWFT  appears  to  be  less  influenced  by  standard  recruiting  practices  (e.g. 
advertising,  familiarisation  visits,  recruiting  officers  etc.),  or  by  provision  of  Sponsorship  or 
other  career  opportunities  at  the  point  of  selection.  There  is,  however,  a  very  clear  relationship 
between  expectations  being  met  and  the  considering  of  withdrawal.  The  report  supports  the 
conclusion  that  RMAS  training  is  more  likely  to  be  rejected  by  those  who  lack  prior  knowledge 
and  experience  of  the  military  or  organised  group  activities  which  provide  similar  experiences. 
The  point  between  RCB  and  Sandhurst  and  the  initial  five  weeks  of  training  are  likely  to  be  the 
most  significant  times  for  influencing  attitudes  towards  RMAS.  There  is  strong  evidence  in  the 
current  report  that  officer  cadets  perceive  a  lack  of  adequate  infonnation  prior  to  commencing 
RMAS.  The  evidence  also  indicates  that  cadets  with  lower  scores  on  certain  personality 
dimensions,  namely,  extroversion,  conscientiousness  and  stability  will  tend  to  report  the 
following:  Fewer  realistic  briefs  about  training  Poorer  levels  of  coping  behaviour  Poorer  level  of 
=soaal  fit4  with  other  cadets  Poorer  understanding  of  their  perfonnance  during  training  Poorer 
levels  of  commitment  All  these  characteristics  were  found  to  predict  expressed  thoughts  of 
voluntary  withdrawal.  The  impact  of  training  feedback  and  counselling  is  also  likely  to  be  of 
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crucial  importance  for  those  harbouring  thoughts  of  leaving,  especially  in  the  early  stages  of 
training  where  most  voluntary  withdrawal  occurs.  Further  understanding  needs  to  be  gained 
about  how  early  socialisation  influences  impact  on  thoughts  of  leaving.  For  example,  to  what 
extent  can  aspects  of  officer  training  be  adapted  to  develop  those  most  likely  to  withdraw? 
However  in  order  to  explore  this  possibility  RMAS  would  require  some  prior  assessment  by 
RCB  of  the  risks  of  VWFT  associated  with  each  new  cadet.  The  paper  concludes  the  best 
predictors  of  VWFT  would  appear  to  be;  personality  measures,  biodata,  and  a  clear  assessment 
of  military  compatibility. 
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cholelithiasis.  A  via  lion,  Space,  and  Environmental  Medicine,  75(7),  681-683. 
BACKGROUND:  This  study  examines  the  aeromedical  outcomes  of  aviation  personnel 
with  asymptomatic  cholelithiasis  or  those  treated  successfully  with  conventional  (open) 
cholecystectomy  (CC),  laparoscopic  cholecystectomy  (EC),  or  extracorporeal  shock  wave 
lithotripsy  (ESWE)  for  previous  symptomatic  cholecystitis.  METHODS:  The  Biomedical 
Database  of  the  Naval  Aerospace  Medical  Institute  was  searched  for  waiver  requests  for 
asymptomatic  gallstones,  acute  cholecystitis,  and  cholecystectomy.  Microfiche  records  were  then 
reviewed.  The  rates  of  development  of  symptomatic  disease  and  need  for  cholecystectomy  or 
ESWL  were  noted  in  aircrew  granted  waivers  for  asymptomatic  cholelithiasis.  The  aeromedical 
outcomes  of  aircrew  who  underwent  treatment  for  symptomatic  disease  by  cholecystectomy  (CC 
or  LC)  or  ESWL  were  reviewed.  RESULTS:  A  search  of  the  Biomedical  Database  revealed 
waiver  requests  for  cholelithiasis  for  79  naval  aviation  personnel  from  April  1988  to  August 
2000.  Waiver  requests  were  for  previous  cholecystectomy  in  56  (70.9%)  and  cholelithiasis  in  23 
(29.1%).  No  aviators  had  undergone  ESWL.  Of  the  56  aviators  with  previous  cholecystectomy, 
waivers  were  granted  in  51  (91.1%)  cases.  Waivers  were  denied  to  five  individuals,  primarily  for 
other  medical  problems.  Of  the  23  aviators  with  cholelithiasis,  1 1  (47.8%)  were  granted  waivers. 
Waivers  were  denied  in  12  aviators  because  of  symptomatic  cholelithiasis  (5),  asymptomatic 
cholelithiasis  (1),  common  bile  duct  stone  (1),  other  medical  problems  (3),  or  no  explanation  (2). 
The  aviator  with  asymptomatic  cholelithiasis  and  two  of  the  aviators  with  symptomatic 
cholelithiasis  were  subsequently  granted  waivers  after  cholecystectomy  (LC).  The  aviator  with  a 
symptomatic  common  bile  duct  stone  received  a  waiver  after  cholecystectomy  (CC).  A  total  of 
66  (83.5%)  aviators  received  waivers.  None  were  revoked  during  the  study  period  because  of 
symptomatic  cholelithiasis  or  retained  common  bile  duct  stones.  CONCLUSIONS:  Aviation 
personnel  who  receive  waivers  for  asymptomatic  cholelithiasis  or  cholecystectomy  rarely  present 
with  symptomatic  biliary  disease. 
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In  1863,  Captain  John  Randolph  Bryan  conducted  the  Confederate  States  Army's  first 
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military  reconnaissance  balloon  flights.  On  his  second  flight,  he  survived  a  class  "A"  aviation 
mishap.  This  article  discusses  the  probable  contributing  mishap  factors  stemming  from  the  lack 
of  an  effective  aviation  medicine  program  with  appropriate  flight  surgeon  input  and 
participation.  Physical  standards,  flying  duty  medical  examinations,  the  Acceptability  Rating  for 
Military  Aeronautics  (ARMA),  crew  rest  regulations,  unit  safety  programs,  physiological 
training,  aviation  life  support  equipment  (ALSE),  night  vision  training,  survival  training,  and 
aircraft  accident  investigation  are  explored. 
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Columbus,  OH. 

This  study  examined  cultural  differences  on  several  general  aptitude  and  personality 
measures.  The  author  notes  that  the  international  standardization  of  psychological  selection  tests, 
although  very  critical,  can  only  be  achieved  if  the  selection  methods  employed  are  culturally  fair. 
This  study  resulted  from  an  attempt  to  develop  norms  for  an  English  version  of  a  psychological 
test  battery,  specifically  focusing  on  two  aspects  of  culture  fairness:  nationality  and  language 
differences.  Subjects  were  scientists  (15  women  and  82  men)  working  in  a  variety  of  areas  (e.g., 
Physics,  Astronomy)  in  several  different  countries.  The  aptitude  tests  in  this  battery  were 
presented  in  either  a  paper-and-pencil  fonnat  or  as  apparatus  tests,  and  were  typical  of  most 
aptitude  batteries  (e-g.,  the  battery  measured  attention,  memory,  psychomotor  function,  etc.).  The 
personality  inventory  was  the  Temperament  Structure  Scales,  which  consists  of  1 1  scales: 
motivation,  emotional  stability,  rigidity,  extroversion,  aggressiveness,  vitality,  dominance, 
empathy,  spoiltness,  mobility  and  openness.  In  addition,  the  State  Trait  Anxiety  Inventory  and 
the  Fear  Survey  Schedule  (which  measures  phobic  behavior  and  generalized  anxiety)  were 
administered.  The  results  showed  that  there  were  significant  differences  in  average  scores 
obtained  across  nationalities  (Northern  Europe  vs.  Southern  Europe)  for  scales  from  the  FSS,  the 
STAI,  and  for  the  openness  scale  of  the  TSS.  An  analysis  of  covariance  revealed  that  there  was  a 
strong  effect  for  knowledge  of  English  and  that  nationality  alone  had  only  a  negligible  effect. 

The  author  discusses  the  implications  of  culturally  biased  tests  for  selecting  aviation  personnel. 
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astronaut  applicants  for  Columbus  Missions  I:  aptitude  testing.  Acta  Astronautica,  27, 

131-138. 

European  participation  in  the  Space  Station  Freedom  brought  about  new  challenges  for 
the  psychological  selection  of  astronaut  candidates,  particularly  in  respect  to  specific  demands  of 
long  duration  space  flights.  For  this  reason  existing  selection  criteria  and  methods  were 
reassessed.  On  these  grounds  a  study  was  undertaken  applying  a  unique  composition  of  aptitude 
tests  to  a  group  of  97  ESA  scientists  and  engineers  who  are  highly  comparable  to  the  expected 
astronaut  applicants  with  respect  to  age  and  education.  The  tests  assessed  operational  aptitudes 
such  as  logical  reasoning,  memory  function,  perception,  spatial  orientation,  attention, 
psychomotor  function,  and  multiple  task  capacity.  The  study  goals  were:  1)  Verification  of 
psychometric  qualities  and  applicability  of  tests  in  a  nonnative  group;  2)  Search  for  culture-fair 
tests  by  which  multi-national  groups  can  be  examined;  3)  Identification  of  test  methods  which 
consider  general  and  special  operational  demands  of  long  duration  space  flights.  Based  on  the 
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empirical  findings  a  test  battery  was  arranged  for  use  in  the  selection  of  ESA  astronaut 
applicants.  Results  showed  that  16  out  of  the  18  employed  tests  have  good  psychometric 
qualities  and  differentiate  reliably  in  the  special  group  of  testees.  The  meta  structure  of  the  test 
battery  as  described  by  a  factorial  analysis  is  presented.  Applicability  of  tests  was  generally  high. 
Tests  were  culture-fair,  however,  a  relation  between  English  language  skills  and  test  results  was 
identified.  Since  most  item  material  was  language-free,  this  was  explained  with  the  importance 
of  English  language  skills  for  the  understanding  of  test  instructions.  Solutions  to  this  effect  are 
suggested. 
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In  the  summer  of  1991,  the  European  Space  Agency  (ESA)  performed  its  second 
selection  campaign  since  1977  in  order  to  find  10  astronaut  candidates  (laboratory  specialists  and 
space  plane  specialists).  An  integral  part  of  this  selection  process  was  the  psychological 
evaluation,  according  to  the  principles  laid  down  in  the  study  report  "Definition  of  Psychological 
Testing  of  Astronaut  Candidates."  After  national  preselection,  59  applicants  underwent  the 
psychological  evaluation,  which  consisted  of  the  assessment  of  operational  aptitudes  (basic 
cognitive  and  psychomotor  functions)  and  personality  traits  (motivation,  social  capability,  stress 
resistance).  The  test  program  included  a  diverse  number  of  tests,  questionnaires,  behavioral 
ratings,  biographical  data,  and  semi-structured  interviews.  About  50  scores  were  available  for 
each  subject.  A  comparison  of  the  test  scores  with  the  original  normative  data,  culture-fairness  of 
the  psychological  selection,  and  discriminant  functions  analyzing  the  assessment  decisions  will 
be  presented  and  discussed. 
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The  objective  of  this  project  was  to  develop  a  methodology  for  predicting  the  selection 
scores  for  pilot  and  navigator  candidates  from  three  different  commissioning  sources  and  from 
active  duty  officer  candidates.  Each  year  the  U.S.  Air  Force  commissions  officers  from  the  US 
Air  Force  Academy  (USAFA),  Officer  Training  School  (OTS),  and  Reserve  Officer  Training 
Corps  (ROTC)  detachments  at  major  universities  and  colleges.  From  these  officers,  each 
commissioning  source  selects  a  number  of  candidates  to  be  sent  to  pilot  and  navigator  training. 
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score.  The  OTS  graduates  who  apply  for  this  training  are  screened  by  an  Air  Force  board  to  rank 
order  candidates  for  selection.  The  ROTC  candidates  are  rank  ordered  using  a  computer  model. 

In  addition,  the  these  three  sources,  a  fourth  source  of  pilot  and  navigator  candidates  is  a  board 
which  is  convened  by  the  Air  Force  Personnel  Center  (AFPC)  to  screen  records  of  previously 
commissioned  officers  who  have  applied  to  be  considered  for  future  training  slots.  Each  of  these 
candidate  selection  sources  were  analyzed  using  the  Policy  Capturing  methodology  to  attempt  to 
predict  the  board  scores  for  the  USAFA,  OTS,  and  AFPC  selection  boards.  In  addition,  sources 
of  bias  in  this  selection  process,  such  as  sex  and  race,  were  investigated. 
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Improvement  Act  of  1996  (PRIA),  which  is  contained  in  Title  V  of  Public  Law  104-264,  110 

Stat.  3259  (1996).  The  statute  requires  air  carriers,  prior  to  hiring  an  individual  as  a  pilot,  to 
request  and  receive:  from  the  Federal  Aviation  Administration  (FAA),  certain  records  pertaining 
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with  all  six  degrees  of  simulator  motion  being  active.  Perfonnance  measurement  is  learning- 
objective  oriented  and  highly  objective.  44  subjects  have  been  tested  so  far.  All-subjects  were 
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beginnings  way  back  in  1916  as  some  mythical  accounts  would  have  it.  Although  it  is  untrue  that 
the  late  "Red  Baron"  made  the  acquaintance  of  aviation  psychologists,  it  is  certainly  true  to  say 
that  all  Gennan  military  pilots  since  the  end  of  WW  I  have  been  confronted  with  aviation 
psychology  in  one  way  or  another,  if  not  with  an  actual  aviation  psychologist,  then  at  least  with 
aviation  psychology  methods  and  instruments.  As  a  general  rule,  such  instruments  would  include 
paper  and  pencil  tests,  and  boxes  with  all  kinds  of  levers,  buttons,  lights  and  bells.  In  the  sphere 
of  aviation,  psychology  was  essentially  synonymous  with  pilot  candidate  selection.  Presumably 
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this  is  also  true  for  other  countries  where  aviation  psychology  is  practiced.  On  the  other  hand, 
aviation  psychologists  were  surprisingly  hesitant  in  touching  two  other  important  areas  of 
aviation,  namely  -  pilot  training  -  psychological  support  for  aviators. 
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This  article  summarizes  the  work  conducted  by  various  government  agencies  to  improve 
the  selection  of  aviation  cadets  during  the  period  around  World  War  II.  Three  different  predictors 
were  tested  using  three  different  samples,  each  of  whom  joined  the  service  under  somewhat 
different  circumstances  (e.g.,  before  or  after  the  war).  The  first  predictor  was  the  Wonderlic 
Personnel  Test  (PT),  which  was  later  to  become  the  Aviation  Classification  Test  (ACT).  It  was  a 
group-administered  intelligence  test  (1  12  items)  that  tapped  vocabulary,  following  directions, 
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Inventory  (BI)  was  used,  which  has  150  items  that  measure  background  variables,  interests, 
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validities  for  predicting  performance  in  ground  school  were  moderately  high  (.20  to  .3  1;  sample 
sizes  were  very  small;  Ns  ranged  from  24-45).  The  validities  of  the  MCT  for  predicting 
flight/ground  school  training  were  moderately  high  (ranging  from  -25  to  .33  across  the  three 
samples).  Finally,  the  BI  did  not  predict  ground  school  failures  (or  "Other  Types  of  Failures") 
very  well,  but  it  did  do  a  good  job  of  predicting  flight  training  failures  (validities  ranging  from 
.29  to  .34  across  these  samples). 
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Wolff-Parkinson-White  (WPW)  syndrome  poses  a  risk  for  tachyarrhythmias  and  sudden 
cardiac  death.  Most  WPW  studies  have  relatively  limited  numbers  of  subjects  and  brief  follow¬ 
up  periods.  METHODS:  We  reviewed  records  of  238  consecutive  military  aviators  with  WPW 
syndrome  evaluated  from  1955  to  1999.  Follow-up  was  by  questionnaires,  telephone  interviews, 
or  death  certificates.  Events  included  sudden  cardiac  death  and  supraventricular  tachycardia 
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(SVT)  (by  electrocardiographic  [ECG]  documentation  or  suggestive  symptoms).  RESULTS:  The 
mean  age  was  34.3  years  (range  17-56  years).  Forty-two  (42/238,  17.6%)  had  SVT  (WPW 
syndrome)  and  196  of  238  (82.4%)  had  the  WPW  ECG  pattern  only.  The  mean  follow-up  of  2 1 .8 
years  (range  2-41  years)  was  obtained  on  228  of  238  (96%)  for  a  total  of  4906  patient-years. 
Sudden  cardiac  death  occurred  in  1  of  228,  an  incidence  of  0.0002  per  patient-year  (95% 
confidence  interval  0.0-0.001).  SVT  occurred  in  47  of  228  (20.6%)  or  0.01  per  patient- year.  One 
hundred  eighty-seven  (187/228,  82%)  initially  had  the  WPW  ECG  pattern  only;  28  of  187 
(15.0%)  reported  SVT  during  follow-up.  Forty-one  (41/228,  18%)  initially  had  WPW  syndrome; 
19  of  41(46.3%)  reported  additional  SVT  during  follow-up.  CONCLUSION:  Sudden  cardiac 
death  risk  was  low  (0.02%/patient-year)  in  this  WPW  population.  The  SVT  incidence  was  1% 
per  patient-year.  Referral  bias  and  some  characteristics  of  the  unique  military  aviator  population 
may  partly  account  for  these  low  event  rates.  However,  these  results  may  be  more  applicable  to 
unselected  populations  than  are  tertiary  referral-based  studies. 
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During  the  past  ten  years  the  writer  and  various  collaborators  have  been  engaged  in 
developing  and  utilizing  a  method  that  has  been  named  the  "critical  incident  technique."  It  is  the 
purpose  of  this  article  to  describe  the  development  of  this  methodology,  its  fundamental 
principles,  and  its  present  status.  In  addition,  the  findings  of  a  considerable  number  of  studies 
making  use  of  the  critical  incident  technique  will  be  briefly  reviewed  and  certain  possible  further 
uses  of  the  technique  will  be  indicated.  The  critical  incident  technique  consists  of  a  set  of 
procedures  for  collecting  direct  observations  of  human  behavior  in  such  a  way  as  to  facilitate 
their  potential  usefulness  in  solving  practical  problems  and  developing  broad  psychological 
principles.  The  critical  incident  technique  outlines  procedures  for  collecting  observed  incidents 
having  special  significance  and  meeting  systematically  defined  criteria.  By  an  incident  is  meant 
any  observable  human  activity  that  is  sufficiently  complete  in  itself  to  permit  inferences  and 
predictions  to  be  made  about  the  person  performing  the  act.  To  be  critical,  an  incident  must  occur 
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new  about  it.  People  have  been  making  observations  on  other  people  for  centuries.  The  work  of 
many  of  the  great  writers  of  the  past  indicates  that  they  were  keen  observers  of  their  fellow  men. 
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behavior.  Perhaps  what  is  most  conspicuously  needed  to  supplement  these  activities  is  a  set  of 
procedures  for  analyzing  and  synthesizing  such  observations  into  a  number  of  relationships  that 
can  be  tested  by  making  additional  observations  under  more  carefully  controlled  conditions. 

Flanagan,  J.  C.,  &  Pitts,  P.  M.  (1944).  Psychological  testing  program  for  the  selection  and 
classification  of  air  crew  officers.  Air  Surgeon  Bulletin,  1(6),  1-5. 

Fleischman,  H.  A.,  Ambler,  R.  K.,  Peterson,  F.  E.,  &  Lane,  N.  E.  (1966).  The  relationship  of  five 
personality  scales  to  success  in  Naval  aviation  training.  Pensacola,  FL:  Naval  Aerospace 
Medical  Institute,  Naval  Aerospace  Medical  Research  Laboratory. 

Fleischman,  H.  L.,  Ambler,  R.  K.,  Peterson,  F.  E.,  &  Lane,  N.  E.  (1966).  The  Relationships  of 
Five  Personality  Scales  to  Success  in  Naval  Aviation  Training.  Naval  Air  Station 
Pensacola,  FL:  Naval  Aerospace  Medical  Institute. 

Fleishman,  E.  A.  (1953).  An  evaluation  of  two  psychomotor  tests  for  the  prediction  of  success  in 
primary  flying  training.  Lackland  Air  Force  Base,  TX:  U.S.  Air  Force  Human  Resources 
Research  Center. 

Fleishman,  E.  A.  (1953).  A  factor  analysis  of  intra-task  performance  on  two  psychomotor  tests. 
Psychometrika,  18,  45-55. 

Fleishman,  E.  A.  (1954).  Evaluations  of  psychomotor  tests  for  pilot  selection:  The  direction 
control  and  compensatory  balance  tests.  Lackland  Air  Force  Base,  TX:  U.S.  Air  Force 
Personnel  and  Training  Research  Center. 

Fleishman,  E.  A.  (1954).  A  factorial  study  of  psychomotor  abilities:  USAF  Personnel  and 
Training  Research  Center. 

Fleishman,  E.  A.  (1956).  Psychomotor  selection  tests:  Research  and  application  in  the  United 
States  Air  Force.  Personnel  Psychology,  9,  449-467. 

Fleishman,  E.  A.  (1957).  Factor  structure  in  relation  to  task  difficulty  in  psychomotor 
perfonnance.  Educational  and  Psychological  Measurement,  17,  522-532. 

Fleishman,  E.  A.  (1975).  Toward  a  taxonomy  of  human  performance.  American  Psychologist, 

30,  1 127-1 147. 

Fleishman,  E.  A.,  &  Hempel,  W.  E.  (1953).  Changes  in  factor  structure  of  a  complex 

psychomotor  test  as  a  function  of  practice.  Lackland  Air  Fore  Base,  TX:  USAF  Human 
Resources  Research  Center. 


106 


Fleishman,  E.  A.,  &  Hempel,  W.  E.  (1954).  Changes  in  factor  structure  of  a  complex 
psychomotor  test  as  a  function  of  practice.  Psychometrika,  19(3),  239-252. 

Scores  obtained  at  eight  different  stages  of  practice  on  the  Complex  Coordination  Test 
together  with  scores  on  18  reference  tests  were  subjected  to  a  Thurstone  Centroid  Factor 
Analysis.  Nine  meaningful  factors  were  identified  in  the  experimental  battery.  The  results 
indicated  considerable,  but  systematic,  changes  in  the  factor  structure  of  the  Complex 
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Subjects  were  assigned  to  one  of  seven  groups  depending  upon  whether  they  were  to  monitor 
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task),  or  some  combination  of  these  three  .  Both  task  performance  and  subjective  ratings  were 
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used  to  assess  subjects'  awareness  of  the  three  object  attributes.  In  addition,  subjective  ratings  of 
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awareness  was  poor  or  the  location  task  is  not  a  good  measure  of  that  awareness  .  Subjective 
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population  (e.g.,  an  all  volunteer  force,  educational  curricula);  (2)  changes  in  Naval  aviation 
training  (e.g.,  increased  use  of  simulators)  and  operational  aircraft  (e.g.,  glass  cockpits);  (3) 
possible  compromises  in  the  test  since  its  revision  13  years  earlier;  (4)  decreased  predictive 
validity;  and  (5)  changes  in  federal  guidance  regarding  employee  selection  procedures. 
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Situational  Awareness  (SA)  is  considered  essential  to  safe  and  expert  pilot  performance. 
The  computer-based  WOMBATTM  test  provides  a  multi-tasking  environment  designed  to  assess 
a  set  of  abilities  thought  to  be  important  for  the  maintenance  of  SA  in  complex  environments. 
There  is  some  evidence  to  suggest  that  perfonnance  on  this  test  is  related  to  elite  pilot 
perfonnance.  This  paper  reports  the  results  of  a  study  assessing  the  predictive  validity  of  the  test 
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with  regard  to  the  training  perfonnance  of  ab-initio  pilot  students.  Performance  measures 
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The  results  did  not  support  the  position  that  WOMBAT  scores  have  predictive  validity  in  relation 
to  the  employed  criterion  variables.  However,  situational  awareness  data  derived  from  a 
subsequent  simulator  study  did  show  the  expected  relationship.  The  results  of  these  studies  are 
discussed  with  respect  to  the  theoretical  and  practical  considerations  pertaining  to  selection, 
training  and  performance.  Consequent  recommendations  center  around  the  alignment  of 
selection,  training  and  perfonnance  measures.  It  is  argued  that  the  use  of  detailed  and  explicit 
developmental  markers  can  result  in  both  a  robust  means  of  assessing  predictive  validity  and 
increased  efficiency  and  effectiveness  of  flight  training. 
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One  of  the  pivotal  contributions  of  Military  Psychology  to  improving  military  personnel 
selection  has  been  the  development  and  utilisation  of  structured,  objective  tests  of  ability  and 
aptitude.  In  contradistinction  to  the  cognitive  domain,  until  recently  there  has  been  little  success 
in  the  application  of  non-cognitive  constructs  to  the  selection  of  pilots.  Researchers  have 
suggested  that  less  intrusive  measures  than  those  currently  employed  may  be  required  to  assess 
the  =deeper‘  aspects  of  the  non-cognitive  domain,  such  as  the  -dark  side”  of  personality.  In  this 
paper,  data  from  a  study  of  a  novel  application  of  Computer  Aided  Text  Analysis  (CAT A)  to  the 
selection  of  RAAF  pilot  trainees  is  further  investigated.  Given  previous  findings  that  suggest 
CATA  has  the  potential  to  be  a  useful  tool  in  pilot  selection,  this  study  elaborates  reasons  for 
pilot  training  failure  beyond  the  bivariate  pass/fail  criterion  previously  employed.  The  use  of  a 
bivariate  pass/fail  criterion  introduces  the  potential  for  attenuation  of  prediction  given  the 
possible  inclusion  of  failures  for  cognitively  based  reasons.  In  this  study,  the  training  suspension 
reports  (TSR‘s)  were  manually  content  analysed  and  failure  themes”  extracted.  The  TSR‘s  were 
encoded  and  results  subjected  to  a  Principal  Components  Analysis  to  determine  if  a  latent 
component  structure  could  be  observed.  From  the  component  structure  matrix  a  number  of  scores 
were  calculated  for  each  applicant.  Themes  extracted  from  a  20  minute  communication  skills 
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incidence  ratios  (SIR’s)  were  calculated  for  aircrew  using  data  from  the  National  Cancer 
Institute's  Surveillance  Epidemiology  and  End  Results  (SEER)  program.  Aviator  age-adjusted 
cancer  rate  ratios  were  also  obtained  using  non- flying  officers  as  an  internal  comparison  group. 
RESULTS:  We  observed  statistically  significant  excesses  of  aircrew  cancers  for  all  sites,  testis, 
and  urinary  bladder.  All  other  aviator  cancer  classifications  were  not  significantly  different  from 
the  comparison  cohort;  most  notably,  cancers  of  the  colon  and  rectum,  skin  (both  malignant 
melanoma  and  non-epithelial),  brain  and  nervous  system,  Hodgkin's  Disease  and  leukemias. 
CONCLUSION:  Previous  studies  of  commercial  pilots  that  demonstrated  excesses  of  these 
cancers  may  have  been  biased  by  the  use  of  external  comparison  groups.  We  used  an  internal 
comparison  population  to  reduce  selection  bias,  information  bias  and  confounding.  From  these 
data  we  detected  notable  excess  aircrew  cancer  risk  for  cancers  of  the  testis,  urinary  bladder,  and 
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all  sites  combined. 
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The  S.A.M.,  Steadiness  Aiming  Test,  Form  B,  proved  to  be  a  mechanically  satisfactory 
measure  of  hand  steadiness.  The  test  had  excellent  reliability.  Validity  of  the  test,  however,  was 
very  low  for  prediction  of  success  in  elementary  pilot  training,  The  addition  of  a  verbal  stress 
element  to  the  S.A.M.  Steadiness  Aiming  Test  did  not  result  in  an  increase  in  validity. 
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To  address  the  selection-related  question,  -What  does  the  personality  profile  of  the  Anny 
aviator  of  today  look  like?”  75  experienced  Anny  aviators  attending  advanced  leadership 
training  completed  the  Revised  NEO  Personality  Inventory,  with  scores  depicting  the  five 
personality  factors  of:  neuroticism,  extraversion,  openness,  agreeableness,  and 
conscientiousness.  To  address  the  classification-related  question,  -Are  there  certain  personality 
profiles  that  distinguish  among  attack,  scout,  cargo,  and  utility  pilots?”  factor  scores  and  their 
subsumed  facet  scores  were  compared  across  respondents  representing  the  four  mission 
platforms.  Overall  sample  profiles  and  score  differences  among  platforms  are  presented. 
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Behavioral  and  Social  Sciences. 

The  U.S.  Army  Research  Institute  for  the  Behavioral  and  Social  Sciences  Rotary  Wing 
Aviation  Research  Unit  (ARI  RWARU)  administered  the  Revised  NEO  Personality  Inventory  to 
217  student  Army  aviators  awaiting  Initial  Entry  Rotary  Wing  training.  Scores  reflected  the 
incoming  aviators1  standings  on  five  personality  factors:  neuroticism,  extraversion,  openness, 
agreeableness,  and  conscientiousness.  The  male  student  factor  and  facet  scores  were  then 
compared  with  a  sample  of  male  career  Army  aviators.  Personality  differences  and  similarities 
between  the  two  samples  are  discussed  as  laying  the  foundation  for  longitudinal  research. 

Griffin,  G.  R.  (1987).  Development  and  evaluation  of  an  automated  series  of  single-  and 

multiple-dichotic  listening  and  psychomotor  tasks.  Pensacola,  FL:  Naval  Aerospace 

Medical  Research  Laboratory. 

Attrition  in  undergraduate  naval  aviation  training  represents  a  costly  problem.  An  average 
of  25%  of  student  naval  aviators  fails  to  complete  training.  This  study  reports  an  effort  to 
develop  automated  single-  and  multiple-dichotic  listening  and  psychomotor  tasks,  which  have 
the  potential  to  reduce  aviator  attrition  through  improved  selection  and  may  also  be  useful  in 
initial  pipeline  classification.  Statistical  analysis  of  Study  I,  comparing  a  forward  and  backward 
series  of  automated  dichotic  listening  (DLT)  and  psychomotor  (PMT)  tasks,  indicated  that  a 
backward-direction  orientation  associated  with  the  psychomotor  tests  resulted  in  increased 
difficulty  for  all  PMT  measures  and  two  of  three  multitask  DLT  measures.  The  correlational 
estimates  of  test-retest  reliability  for  the  multitask  DLT  and  PMT  measures  were  adequate  for 
both  series  of  automated  tasks  but  slightly  higher  (r  -  .80  DLT,  r  -  .90  PMT)  for  the  backward 
series.  There  were  significant  correlations  between  the  DLT  and  PMT  tasks,  for  each  series  of 
single-  and  multitask  measures.  The  relation  between  such  seemingly  different  tasks  is  difficult 
to  understand  since  the  DLT  is  an  auditory  cognitive  processing  task,  and  the  PMT  is  an  eye, 
hand,  foot  coordination  task.  However,  the  significant  correlations  were  both  smaller  and  fewer 
in  number  for  the  backward  series  of  automated  tests.  Study  II  was  a  correlational  evaluation 
between  the  new  automated  multitask  measures  and  old  nonautomated  tasks  with  demonstrated 
validity  for  the  prediction  of  primary  flight  performance.  The  correlations  between 
corresponding  tasks  of  the  new  automated  and  old  nonautomated  tasks  averaged  .60  for  the  DLT 
measures  and  .66  for  the  PMT  tasks.  The  results  of  Study  III  indicated  that  certain  automated 
DLT  and  PMT  measures  were  significantly  related  to  primary  flight  grades  (PFG)  in  Navy  flight 
training.  For  the  backward  series  of  tasks,  all  DLT  and  PMT  measures  were  significantly 
correlated  with  PFG.  However,  only  two  DLT  and  two  PMT  measures  of  the  forward  series  were 
significantly  related  to  FFG.  No  significant  correlations  were  found  between  the  automated  DLT 
and  PMT  tests  and  the  pass/fail  criterion.  The  absence  of  a  suitable  number  of  flight  failure 
attritions  was  discussed  as  a  possible  reason  for  this  result.  A  regression  analysis  for  the 
backward  series  of  test  measures  and  primary  flight  training  criteria  indicated  that  a  psychomotor 
stick  and  rudder  measure  and  the  FAR  selection  test  were  significantly  related  to  PFG  (R  =  .53,  F 
(2,85)  =  16.56,  p  <  .000  1).  There  were  no  significant  correlations  between  the  automated  DLT 
and  PMT  measures  and  prior  flight  hours.  These  results  indicate  that  a  series  of  automated  DLT 
and  PMT  tasks  are  suitable  replications  of  an  older  version  of  nonautomated  tasks.  The 
advantages  of  the  automated  tasks  are  that  they  require  less  administrative  support  and  provide 
automatic  scoring  of  performance.  The  backward  series  of  automated  tasks,  which  was  correlated 
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more  strongly  with  criterion  perfonnance,  should  be  administered  to  a  large  sample  of  student 
naval  aviators  to  detennine  if  the  tests  can  account  for  additional  variance  in  the  prediction  of 
flight  training  perfonnance  beyond  that  of  current  selection  tests. 
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dichotic  listening  tasks.  Paper  presented  at  the  32nd  Annual  Meeting  of  the  Human 
Factors  Society. 

A  series  of  automated  psychomotor  and  dichotic  listening  tasks,  which  require  little 
administrative  support  and  provide  automatic  scoring  of  performance,  has  been  developed.  The 
automated  tasks  account  for  additional  variance  in  predicting  Navy  flight  training  performance 
beyond  that  of  current  selection  tests. 

Griffin,  G.  R.  (1998).  Predicting  Naval  Aviator  Flight  Training  Perfonnance  Using  Multiple 
Regression  and  an  Artificial  Neural  Network.  International  Journal  of  Aviation 
Psychology,  5(2),  121-135. 

Evaluates  the  prediction  of  naval  aviator  flight  training  performance  in  whiting  Field, 
Florida.  Use  of  multiple  regression  and  an  artificial  neural  network;  Conduction  of  cognitive  and 
perceptual  psychomotor  tests;  Efficiency  in  predicting  flight  grade  training  performance. 

Griffin,  G.  R.,  &  Hopson,  J.  A.  (1978).  An  Evaluation  of  the  Omnibus  personality  Inventory  in 
the  Prediction  of  Attrition  in  Naval  Aviation  Training.  Naval  Air  Station  Pensacola,  FL: 
Naval  Aeromedical  Research  Laboratory. 

The  numerous  Navy  research  efforts  to  identify  motivational  predictors  of  student  naval 
aviator  and/or  student  naval  flight  officer  attrition  have  met  with  little  success.  In  spite  of  the 
failures  associated  with  the  application  of  personality  or  motivational  measures  to  naval  aviation 
populations,  there  is  little  doubt  that  much  of  the  attrition  in  naval  aviation  training  is  of  a 
motivational  origin.  As  a  result,  research  personnel  continue  to  seek  motivational  measures  that 
may  identify  those  individuals  most  likely  to  succeed  in  training.  The  present  report  describes  an 
evaluation  of  the  Omnibus  Personality  Inventory  (OPI)  as  a  predictor  of  student  motivational 
attrition  in  naval  aviator  flying  training.  Initial  validation  results  suggested  that  certain  OPI 
scales  were  predictive  of  student  naval  aviator  and  student  naval  flight  officer  success  in  naval 
flying  training  programs.  A  cross-validation  analysis  was  conducted  to  determine  the  stability  of 
these  findings.  The  analysis  indicated  that  significant  cross-validity  relationships  existed  for 
current  selection  tests  but  not  for  OPI  predictor  measures.  It  must  be  concluded  that  the  OPI  is 
not  sufficiently  related  to  student  aviator  training  performance  to  be  of  value  in  the  prediction  of 
aviator  motivational  attrition.  These  results  support  previous  conclusions  that  future  aviation 
selection  research  should  be  directed  toward  the  identification  of  perfonnance  oriented,  non- 
paper-and-pencil  measures  as  motivational  predictors. 

Griffin,  G.  R.,  &  Koonce,  J.  M.  (1996).  Review  of  Psychomotor  Skills  in  Pilot  Selection 

Research  of  the  U.  S.  Military  Services.  International  Journal  of  Aviation  Psychologv, 
6(2),  125. 

Focuses  on  the  historical  perspective  of  the  use  of  psychomotor,  perceptual-cognitive 
paper- and -pencil  and  tests  for  the  selection  of  pilot  trainees  by  the  military  services  in  the  U.S. 
Combination  of  paper-and-pencil  and  automated  psychomotor  tests  for  initial  selection;  Use  of 
automated  cognitive  and  psychomotor  tests;  Predictors  of  pass-fail  criteria.  Focuses  on  the 
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for  the  selection  of  pilot  trainees  by  the  military  services  in  the  U.S.  Combination  of  paper-and- 
pencil  and  automated  psychomotor  tests  for  initial  selection;  Use  of  automated  cognitive  and 
psychomotor  tests;  Predictors  of  pass-fail  criteria. 

Griffin,  G.  R.,  &  McBride,  D.  K.  (1986).  Multitask  performance:  Predicting  success  in  naval 
aviation  primary  flight  training.  Naval  Air  Station  Pensacola,  FL:  Naval  Aeromedical 
Research  Laboratory. 

Attrition  in  undergraduate  naval  aviation  training  represents  a  costly  problem.  An  average 
one  in  four  student  naval  aviators  fails  to  complete  training.  This  study  represents  an  attempt  to 
reduce  aviator  attrition  through  improved  selection.  A  multitask  experiment  simulating  certain 
motor  control  and  communication  requirements  characteristic  of  flight  was  conducted  to 
detennine  relative  strengths  of  several  perfonnance  measures  as  predictors  of  primary  flight 
training  success. 

Griffin,  G.  R.,  Morrison,  T.  R.,  Amerson,  T.  L.,  &  Hamilton,  P.  V.  (1987).  Predicting  air  combat 
maneuvering  (ACM)  perfonnance:  Fleet  fighter  readiness  program  grades  as 
perfonnance  criteria.  Naval  Air  Station  Pensacola,  FL:  Naval  Aeromedical  Research 
Laboratory. 

A  difficult  aspect  of  predicting  fleet  pilot  perfonnance  is  acquiring  meaningful  and 
reliable,  inflight  criteria.  Without  such  criteria  ,  performance  assessment  is  both  theoretically  and 
realistically  impossible.  This  study  was  an  attempt  to  predict  Air  Combat  Maneuvering  (  ACM) 
perfonnance  using  performance  -  based  laboratory  tests  and  to  evaluate  the  VF-43  adversary 
squadron  ’  s  grading  of  inflight  ACM  performance  in  the  Fleet  Fighter  ACM  Readiness  Program 
at  Naval  Air  Station  Oceana  .  The  purpose  of  the  latter  effort  was  to  select  convenient  and 
reliable  criteria  for  ACM  perfonnance  assessment  and  use  in  the  validation  of  the  laboratory 
tests.  In  an  initial  evaluation  (Study  I  ),  F-4  pilots  performed  in  Fleet  Fighter  ACM  Readiness 
exercises  and  completed  performance  -  based  perceptual  motor  and  multitask  tests.  Results 
indicated  that  dichotic  listening  test  measures  ,  obtained  during  multitask  conditions,  could  be 
used  to  reliably  predict  ACM  inflight  criteria  .  Results  of  a  larger  sample  of  F-14  pilots  (  Study 
II)  indicated  that  an  overall  ACM  grade  (OAG)  assigned  by  VF  -  43  adversary  personnel  can  be 
predicted  reliably  by  an  objective  kill  difference  composite  score  and  three  subjective  measures  : 
situational  awareness,  mutual  support ,  and  energy  management.  These  four  measures  accounted 
for  78  %  of  the  variance  with  the  OAG.  A  correlational  analysis  suggests  that  the  VF-43  grading 
process  is  reliable  and  consistent.  Additional  results  were  obtained  on  the  relation  between  the 
Naval  Aerospace  Medical  Research  Laboratory  vision  tests  and  ACM  criteria  (  Study  III). 
Contrast  sensitivity  measures  were  significantly  related  to  a  mean  time-to  -  first-  kill  measure. 
Visual  acuity  and  accommodative  flexibility  measures  were  significantly  related  to  the  initial 
sighting  (tally  -  ho)  and  visual  identification  (VID)  of  adversary  aircraft  on  an  instrumented 
range.  Age  and  /  or  experience  in  ACM  may  be  an  important  variable  in  relating  vision  tests  to 
pilot  performance.  It  is  recommended  that:  (1)  improved  perfonnance  -  based  tests  should  be 
administered  to  a  sample  of  Navy  pilots  performing  in  Fleet  Fighter  ACM  Readiness  Evaluations 
to  replicate  initial  test  results  ;  and  (2)  an  overall  ACM  grade  regression  equation  should  be 
applied  to  a  supplementary  sample  of  pilots  performing  in  Fleet  Fighter  ACM  Readiness 
exercises  to  confirm  the  reliability  and  validity  of  the  VF-43  adversary  squadron’ s  grading 
process. 
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Attrition  in  undergraduate  naval  aviation  training  represents  a  costly  problem.  An  average 
of  25%  of  student  naval  aviators  fails  to  complete  training.  This  study  reports  an  effort  to 
develop  automated  single-  and  multiple-dichotic  listening  and  psychomotor  tasks,  which  have 
the  potential  to  reduce  aviator  attrition  through  improved  selection  an  may  also  be  useful  in 
initial  pipeline  classification.  Statistical  analysis  of  Study  I,  comparing  a  forward  and  backward 
series  of  automated  dichotic  listening  (DLT)  and  psychomotor  (PMT)  tasks,  indicated  that  a 
backward-direction  orientation  associated  with  the  psychomotor  tests  resulted  in  increased 
difficulty  for  all  PMT  measures  and  two  of  three  multitask  DLT  measures.  The  correlational 
estimates  of  test-retest  reliability  for  the  multitask  DLT  and  PMT  measures  were  adequate  for 
both  series  of  automated  tasks  but  slightly  higher  (r  -  .80  DLT,  r  -  .90  PMT)  for  the  backward 
series.  There  were  significant  correlations  between  the  DLT  and  PMT  tasks,  for  each  series  of 
single-  and  multitask  measures.  The  relation  between  such  seemingly  different  tasks  is  difficult 
to  understand  since  the  DLT  is  an  auditory  cognitive  processing  task,  and  the  PMT  is  an  eye, 
hand,  foot  coordination  task.  However,  the  significant  correlations  were  both  smaller  and  fewer 
in  number  for  the  backward  series  of  automated  tests.  Study  II  was  a  correlational  evaluation 
between  the  new  automated  multitask  measures  and  old  nonautomated  tasks  with  demonstrated 
validity  for  the  prediction  of  primary  flight  performance.  The  correlations  between 
corresponding  tasks  of  the  new  automated  and  old  nonautomated  tasks  averaged  .60  for  the  DLT 
measures  and  .66  for  the  PMT  tasks.  The  results  of  Study  III  indicated  that  certain  automated 
DLT  and  PMT  measures  were  significantly  related  to  primary  flight  grades  (PFG)  in  Navy  flight 
training.  For  the  backward  series  of  tasks,  all  DLT  and  PMT  measures  were  significantly 
correlated  with  PFG.  However,  only  two  DLT  and  two  PMT  measures  of  the  forward  series  were 
significantly  related  to  FFG.  No  significant  correlations  were  found  between  the  automated  DLT 
and  PMT  tests  and  the  pass/fail  criterion.  The  absence  of  a  suitable  number  of  flight  failure 
attritions  was  discussed  as  a  possible  reason  for  this  result.  A  regression  analysis  for  the 
backward  series  of  test  measures  and  primary  flight  training  criteria  indicated  that  a  psychomotor 
stick  and  rudder  measure  and  the  FAR  selection  test  were  significantly  related  to  PFG  (R  =  .53,  F 
(2,85)  -  16.56,  p  <  .000  1).  There  were  no  significant  correlations  between  the  automated  DLT 
and  PMT  measures  and  prior  flight  hours.  These  results  indicate  that  a  series  of  automated  DLT 
and  PMT  tasks  are  suitable  replications  of  an  older  version  of  nonautomated  tasks.  The 
advantages  of  the  automated  tasks  are  that  they  require  less  administrative  support  and  provide 
automatic  scoring  of  performance.  The  backward  series  of  automated  tasks,  which  was  correlated 
more  strongly  with  criterion  perfonnance,  should  be  administered  to  a  large  sample  of  student 
naval  aviators  to  detennine  if  the  tests  can  account  for  additional  variance  in  the  prediction  of 
flight  training  perfonnance  beyond  that  of  current  selection  tests. 
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Several  studies  have  suggested  the  possibility  of  predicting  operational  performance  in 
fleet  aviation  environments.  This  report  concerns  the  use  of  an  automated  performance-based  test 
battery,  involving  cognitive  and  psychomotor  functioning,  to  predict  the  operational  performance 
of  fighter  pilots.  Two  groups  of  pilots  who  were  completing  fleet  replacement  squadron  (FRS) 
training  for  the  F/A-18  were  tested  on  this  battery.  The  older  and  more  experienced  pilot  group 
got  higher  FRS  grades  than  did  the  other  group;  test  perfonnance  between  these  two  groups  was 
not  significantly  different.  Those  few  significant  correlations  found  between  the  test  measures 
and  the  FRS  grades  were  illogically  patterned  and  of  insufficient  quantity  or  strength  to 
demonstrate  any  reliable  predictive  ability.  This  could  have  been  due  to  the  homogeneous  nature 
of  each  of  these  subject  groups  in  terms  of  piloting  skills  and  abilities.  Keywords:  Pilot  selection; 
Pipeline  assignment;  Psychomotor  ability;  Cognition;  Dichotic  listening;  Multitask  performance; 
Fleet  aviation  perfonnance;  Jet  fighters;  Flight  training,  (jg) 
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Since  1947,  the  Navy  has  relied  on  the  Aviation  Qualification  Test  (AQT)  of  general 
ability  and  the  Flight  Aptitude  Rating  (FAR)  —  a  composite  of  mechanical  comprehension, 
spatial  aptitude,  and  biographical  tests— to  select  naval  aviators.  While  this  selection  system  has 
served  the  Navy  well,  the  failure  rate  of  pilot  selectees  has  remained  consistently  high  (although 
certainly  less  than  the  attrition  rate  before  using  a  selection  test  battery),  averaging  20-25%  over 
the  last  20  years.  The  cost  of  these  failures  represents  millions  of  Navy  training  dollars  lost  each 
year.  As  a  result,  researchers  at  the  Naval  Aerospace  Medical  Research  Laboratory  have 
attempted  repeatedly  to  improve  selection  test  batteries.  While  previous  efforts  have  failed,  new 
research  results  appear  to  have  the  potential  to  improve  our  selection  of  pilots  and  naval  flight 
officers. 
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The  purpose  of  this  study  was  to  develop  empirical  keys  to  predict  a  variety  of  training 
outcomes  using  the  Strong  Vocational  Interest  Blank  (SVIB)  and  the  Officer  Biographical  and 
Attitudinal  Survey  (OBAS).  Subjects  were  593  pilot  candidates  who  entered  pilot  training 
through  Officer  Training  School  (OTS).  (It  is  interesting  to  note  that  UPT  trainees  from  OTS 
represented  the  largest  percentage  of  eliminees.)  The  SVIB  has  54  occupational  keys  and  five 
supplemental  keys.  The  OBAS  is  a  1 16-item  inventory  which  contains  a  variety  of  background 
and  attitudinal  items.  It  also  contains  the  importance-possibility  scale,  which  measures  the 
importance  of  certain  career  needs  and  how  likely  it  is  that  those  career  needs  can  be  met  by  the 
Air  Force.  The  predictive  utility  of  the  Air  Force  Officer  Qualifying  Test  (AFOQT)  score  was 
also  examined.  Four  criteria  were  used:  total  elimination  (UPT  pass/fail),  Flying  Deficiency 
Elimination  (FLY),  Self-Initiated  Elimination  (SIE)  and  Motivational  Deficiency  Elimination 
(SIEMOA).  Regression  analyses  were  conducted  to  examine  the  prediction  obtained  using  the 
keys  and  the  number  of  pilots  correctly  classified  as  passing  or  failing  UPT  using  several 
different  prediction  models.  The  OBAS  keys  demonstrated  significant  cross-validity  only  for 
UPT  pass/fail  (R  =  .13,  p  <  .05)  and  the  FLY  (R  =  .14,  p  <  .05)  criteria.  Seventeen  of  the  SVIB 
occupational  scales  demonstrated  significant  zero-order  validities  with  UPT  pass/fail  resulting  in 
a  multiple  correlation  of  .45  (not  cross-validated).  Three  different  models  combining  a  variety  of 
these  predictors  were  tested.  Model  1  consisted  of  the  17  SVIB  scales,  the  four  OBAS  keys  and 
the  AFOQT  (cross-validity  =  .14,  p  <  .05).  Model  2  consisted  of  just  the  17  SVIB  scales  and  the 
AFOQT  (cross-validity  =  .111  ns).  Finally,  Model  3  consisted  of  the  four  OBAS  keys  and  the 
AFOQT  (cross-validity  =  .14,  p  <  .05).  With  respect  to  classification  of  pass  or  fail,  Model  1  was 
the  most  efficient,  resulting  in  an  overall  correct  classification  of  7  1  percent.  The  authors 
conclude  that  non-cognitive  data  have  practical  value  in  the  selection  of  pilot  trainees. 
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Psychological  diagnostics  are  often  charged  with  predicting  how  well  a  person  will 
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perform  under  LOAD  in  a  precarious  situation.  It  is  all  the  more  paradoxical  that  the  data  upon 
which  such  prognoses  have  traditionally  been  based  are  invariably  won  under  neutral,  if  not  to 
say  sterile,  conditions  -  a  far  cry  from  the  actual  situation  under  question.  Sports  and  Traffic 
psychologists  have  undertaken  to  make  amends  for  this  shortcoming  by  simulating  the  real-life 
conditions  in  the  laboratory.  This  strategy,  however,  has  its  price;  for  in  so  doing,  the 
psychologist  must  make  compromises  in  objectifying  specific  behavioral  dimensions  separately. 
As  the  laboratory  simulation  approximates  the  actual  demands  upon  everyday  perfonnance  for 
the  behavior  studied,  the  single,  unique  capability,  dimensions  become  confounded,  hopelessly 
intenningled.  The  effect  is  that  prognoses  regress  to  the  range  of  chance. 
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Rash  as  it  may  seem  to  draw  any  lesson  as  yet  from  the  present  war,  in  which  the  great 
Nordic  race  which  embraces  the  dominant  elements  in  all  the  belligerent  nations  is  committing 
suicide,  the  following  points,  which  can  be  only  hinted  at  in  my  twenty  minutes,  seem  to  me 
worthy  of  consideration  here.  Mr.  Hafiner,  through  whom  most  of  us  receive  our  foreign 
periodicals,  writes,  "About  one  thousand  French  and  German  scientific  publications  have 
suspended  as  a  result  of  the  war,  and  about  half  of  those  that  remain  have  been  issued  less 
frequently  or  in  reduced  size."  They  have  also  suffered  in  quality  because  so  many  collaborators 
doing  the  best  work  have  been  sent  to  the  front,  and  many  of  them  wounded  or  killed.  About  all 
the  research  being  now  carried  on  is  in  the  medical  field  and  in  hospitals.  Since  April  last 
practically  all  continental  publications  have  been  kept  out  of  this  country.  This  affects  not  only 
our  journal  clubs  but  cuts  us  off  from  the  stimulus  of  European  thought,  so  that  we  are  now  the 
only  great  country  in  the  world  where  research  can  go  on  as  before. 
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A  major  focus  of  research  in  crew  resource  management  (CRM)  has  been  the  association 
between  personality  and  effective  small-group  leadership.  In  addition,  the  airline  industry 
attempts  to  assess  personality  and  temperament  by  placing  pilot  candidates  through  a  two  or 
three  stage  interview  process.  In  an  ongoing  effort  at  Auburn  University  to  develop  a 
comprehensive  a  Pilot  Candidate  Selection  Model,  the  authors  have  studied  the  relationship 
between  the  professional  pilot4  s  approach  toward  people  as  resources  to  accomplish  goals  and 
perception  of  effective  leader  behavior.  Christie  and  Geis‘  Mach  V  scale  (as  a  construct  of  skill 
in  small  group  leadership)  and  a  modification  of  the  Bernard  Bass  Leadership  Questionnaire  (as 
a  construct  of  leader  perception)  were  employed  in  the  survey  of  98  Air  Force  officers  3 1  of 
which  were  serving  actively  as  rated  pilots.  Research  indicates  a  significant  relationship  in 
success  in  leadership  of  small  groups  and  the  Mach  V  scores.  Using  the  measurements  of  the 
modified  Bass  questionnaire  and  the  Mach  V  inventory  as  predictor  variables,  the  authors 
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derived  a  discriminant  function  identifying  pilots  with  ninety  percent  accuracy.  Results  indicate 
the  potential  use  of  the  Mach  V  and  the  Bass  Leadership  Questionnaire  as  supporting  instruments 
in  the  screening  of  candidates  for  commercial  pilot  training.  The  authors  recommend  extending 
current  research  to  Part  141  flight  training  centers  to  validate  the  potential  of  the  Mach  V  and  the 
Bass  instruments  in  evaluating  students  applying  for  commercial  pilot  training. 
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The  purpose  of  this  study  was  to  re-explore  possible  factors  that  influenced  the  subjects4 
visual-spatial  information  processing  as  they  took  mental  rotation  tests.  Two  types  of  mental 
rotation  tests  were  designed  to  measure  subjects4  visual-spatial  abilities.  One  type  of  mental 
rotation  task  required  the  subject  to  distinguish  figure's  rotation  angle  between  <90  and  >  90 
degrees.  All  177  subjects  of  four  groups  varying  in  flight  experience  (0  hr,  8-23  hrs,  82-85  hrs 
and  instructor-pilots)  were  assessed  with  80  stimuli.  The  results  of  the  comparison  among  four 
groups  indicated  that  the  accuracy  ratio  was  the  most  reliable  factor  in  measuring  individuals4 
visual-spatial  ability.  The  increase  of  complexity  level  could  be  considered  to  improve  this 
experiment.  Another  type  of  mental  rotation  task  required  the  subject  to  distinguish  between  an 
object  and  its  mirror  image.  Different  complexity  levels  of  stimuli  were  used.  All  70  subjects  of 
two  groups  (passed  and  failed  12-15  hour  flying  training  program)  were  assessed  with  240 
stimuli.  The  componential  analysis  was  used  to  analyze  the  infonnation  process  of  the  mental 
operation.  The  results  indicated  that  the  task's  internal  validation  was  good  and  the  estimation  of 
the  higher  level  of  complexity  stimuli  was  significant.  The  parameter  pool  of  pilots  selection 
module  examined  the  parameters  that  estimated  by  the  componential  analysis.  The  results 
indicated  that  mental  rotating  tests,  using  higher  level  of  complexity  stimuli,  could  be  considered 
as  part  of  the  test  for  pilot  selection  battery. 
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There  are  a  variety  of  on-going  attempts  to  generate  unmanned  aerial  vehicle  (UAV) 
technologies  to  exploit  the  advantages  that  these  semiautomated  and  automated  airborne 
platforms  promise  to  render.  (Although  we  refer  specifically  to  UAVs  here,  our  arguments  apply, 
in  principle,  to  all  remote  vehicles  whatever  their  medium  of  operation.  The  principles 
themselves  also  extend  to  other  forms  of  nontransport-based  entities.)  With  regard  to  such 
operations,  the  collective  community  is  searching  for  the  ratio  between  operator(s)  and  vehicle(s) 
that  will  prove  most  efficient  and  effective. 
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Selection  of  Aircrew  Personnel.  Paper  presented  at  the  32nd  Annual  Military  Testing 

Association  Conference,  Orange  Beach,  AL. 

The  Selection  of  Air  Force  and  Navy  flight  personnel  is  a  progressive  process, 
commencing,  before  the  enlistment  of  the  candidates  (Phases  1  and  2)  and  continuing  after  the 
nonnal  military  training  (which  lasts  for  approximately  one  year)  into  Phase  3.  The  first  Phase  is 
a  general  screening  of  such  factors  as  Intelligence  and  Leadership  qualities,  carried  out  in  the 
respective  Officer  or  NCO  Selection  Centres.  The  second  Phase  is  a  preliminary  flight-aptitude 
screening,  using  Computer-based  psychological  tests,  grading  candidates  as  broadly  =Suitable‘  or 
=Lhsuitable‘.  The  third  Phase  is  more  precise,  making  a  final  decision  as  to  candidate  suitability 
and  further  predicting  what  particular  activity  each  candidate  would  be  best  suited  for  (e.g.  Jet, 
WSO,  Prop,  Helicopter  or  Navigator).  It  consists  of  3  weeks  Navigation/Academic  instruction,  1 
week  FPS  80  Selection  and  for  those  who  have  survived  thus  far,  5  weeks  Flying  instruction  on 
light  prop  aircraft,  including  18  flying  hours.  FPS  80  is  the  abbreviation  for  the  Flight 
Psychological  Selection  System  of  the  Aviation  Psychology  Section,  Aerospace  Medical 
Institute  of  the  German  Air  Force.  As  the  need  was  identified  to  improve  the  effectivity  and 
reliability  of  the  Selection  System,  FPS  80  was  conceptualised.  It  was  then  designed  and  a 
detailed  Functional  Specification  was  prepared,  from  which  the  required  Hardware  and  Software 
was  commissioned.  FPS  80  was  installed  in  July  of  1987,  from  which  time  it  was  further  tested 
and  standardized.  It  was  introduced  as  part  of  the  selection  process  on  the  1st  April,  1990.  In  this 
paper,  we  will  concern  ourselves  with  a  description  and  statistical  evaluation  of  the  FPS  80 
Selection  system. 
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For  years  pilot  selection  has  focused  primarily  on  the  identification  of  individuals  with 
superior  flying  skills  and  abilities.  More  recently,  the  aviation  community  has  become 
increasingly  aware  that  successful  completion  of  a  flight  or  mission  requires  not  only  flying 
skills,  but  the  ability  to  work  well  in  a  crew  situation.  This  paper  describes  the  development, 
validation  and  computerization  of  a  situational  judgment  test,  called  the  Situational  Test  of 
Aircrew  Response  Styles  (STARS),  which  targets  the  interpersonal  skills  necessary  to  function 
effectively  in  a  crew  situation.  Recent  research,  especially  in  the  crew  resource  management 
(CRM)  area,  highlights  the  importance  of  interpersonal  skills  and  certain  personality  traits  for 
effective  pilot  perfonnance.  This  crew  resource  management  research  was  motivated  by  analyses 
of  the  causes  of  aircraft  accidents  which  showed  that  the  majority  of  these  accidents  involved 
crew  errors  (Foushee,  1984).  Further  analysis  indicated  that  aspects  of  the  crews'  interpersonal 
interactions  such  as  breakdowns  in  coordination  and  communication  most  frequently  played  a 
causal  role  in  these  accidents  (e.g.,  Cooper,  White,  &  Lauber  1980).  Helmreich  (1987) 
hypothesized  that  pilot  perfonnance  is  determined  by  ability,  personality,  and  attitudes,  and 
suggested  that  since  the  first  two  variables  are  very  difficult  to  change,  crew  resource 
management  training  should  focus  on  changing  attitudes.  Thus,  training  can  be  viewed  as  a  way 
to  promote  awareness  of  group  dynamics,  bring  about  attitude  change,  and  improve  interpersonal 
skills,  but  it  does  not  change  the  underlying  traits  that  have  been  shown  to  be  related  to  crew 
resource  management.  However,  selection  based  on  personality  traits  and/or  relevant 
interpersonal  skills  may  enhance  crew  resource  management  perfonnance,  above  and  beyond 
what  could  be  expected  from  crew  resource  management  training  alone. 
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This  report  describes  research  done  by  the  Human  Resources  Research  Organization 
Force  on  the  first  phase  of  project  RELAY,  The  Impact  of  Military  national  Aspirations  and 
Development  of  Skills.  The  overall  purpose  of  the  research  is  to  increase  the  degree  of  benefits 
of  an  occupational  nature  achieved  by  military  personnel,  during  and  after  active  duty  ,  through 
improvements  in  the  interface  and  civilian  occupational  manpower  systems.  The  research  efforts 
are  expected  to  contribute  to  this  goal  by  providing  infonnation  needed  for  better  manage 
linkages  and  interchanges  between  the  military  and  civilian  manpower  systems. 
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The  Air  Force  Officer  Qualifying  Test  (AFOQT)  is  an  aptitude  measure  used  to  select 
officers,  pilots,  and  combat  system  operators.  This  technical  report  reviews  research  that  answers 
many  common  questions  about  the  AFOQT,  including  whether  the  test  is  fair,  whether  it  is 
biased  against  minorities  or  women,  whether  it  is  too  expensive,  whether  it  should  be  replaced, 
and  whether  it  predicts  the  performance  that  is  important  to  the  Air  Force.  In  addressing  these 
questions,  we  do  not  produce  original  data  analyses.  Instead,  we  present  a  synthesis  of  the 
existing  knowledge  about  the  AFOQT  and  other  selection  tests  and  examine  its  implications  for 
the  future  of  the  AFOQT. 
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The  training  effectiveness  literature  has  paid  little  attention  to  the  potentially  dynamic 
interaction  of  individual  differences  with  various  phases  of  training  in  determining  ultimate 
training  success.  This  study  investigates  the  role  of  individual  differences  in  explaining  the 
transfer  of  learning  from  1  phase  of  training  to  another  among  pilot  trainees  in  a  multistage, 
aviation  training  program.  Using  3  of  the  Big  Five  factors  (Conscientiousness,  Emotional 
Stability,  Openness  to  Experience),  the  results  showed  these  measures  to  contribute  to  the 
prediction  of  the  number  of  hours  it  took  for  trainees  to  attain  their  private  pilot's  license. 
Significant  interactions  between  some  of  these  measures  and  success  on  an  earlier,  simulator 
phase  of  the  training  program  were  also  found.  The  results  are  discussed  in  terms  of  both  the  role 
of  individual  differences  in  training  research  as  well  as  the  broader  issue  of  transfer  of  learning 
between  phases  of  training. 

Hertli,  P.  (1982).  The  prediction  of  success  in  Army  aviator  training:  A  study  of  the  Warrant 

Officer  Candidate  selection  process.  Fort  Rucker,  AL:  U.S.  Anny  Research  Institute  for 
the  Behavioral  and  Social  Sciences. 

Hertsgaard,  B.  C.  (1987).  Birth  order  and  the  aviator.  Maxwell  Air  Force  Base,  AL:  Air 
Command  and  Staff  College. 

This  report  conducts  limited  exploratory  research  into  the  possible  relationship  between 
birth  order  and  an  above  average  aptitude  for  aviation  training.  It  reviews  some  of  the  basic 
elements  of  the  science  of  ethology,  birth  order  traits  and  possible  correlations  to  military 
aviators.  The  study  concludes  that  actual  research  into  the  Navy  and  Air  Force  aviator 
populations  should  be  conducted  to  establish  what,  if  any,  relationship  exists.  Improved  selection 
criteria  might  be  established. 
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This  chapter  documents  the  80-year  history  of  military  pilot  selection,  both  theory  and 
methodology  of  a  variety  of  different  countries  with  a  focus  on  the  U.S.  The  authors  reviewed  a 
great  deal  of  research  on  psychomotor  skill/quickness  and  intelligence/aptitude,  but  only  the 
portions  of  the  chapter  dealing  with  "personality/character"  are  reviewed.  Self-selection  and 
rigorous  physical  examinations  played  a  major  role  in  early  military  pilot  selection,  with  only  the 
most  adventurous  people  volunteering.  During  the  period  prior  to  1919,  the  measurement  of 
emotional  coolness  under  pressure  was  the  focus  of  pilot  screening.  Later,  ingenuity  and  courage 
were  added  in  screening  for  air-to-air  combat,  and  interviews  and  observation  were  the  main 
approaches  for  tapping  these  characteristics.  From  1919  to  1938,  successful  combat  pilots  were 
characterized  as  quiet,  methodical  men,  not  given  to  emotional  excitement,  who  were  able  to 
inhibit  instincts  of  self-preservation.  At  this  time,  Germany  pioneered  the  use  graphology  to  fonn 
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judgments  of  pilot  characterological  suitability  (Wyatt  &  Teuber,  1944).  The  U.S.  Anny  and 
Navy  used  interviews  to  judge  psychiatric  well-being,  while  Gennany  continued  to  emphasize 
observation  of  facial  expressions  and  emotional  reactions  to  stresses.  From  1938  to  1945,  the 
U.S.  Army  Air  Force  found  that  commercially  available  paper-and-pencil  personality  tests  did 
not  contribute  to  pilot  selection,  while  European  countries  "emphasized  screening  pilots  for  the 
proper  character"  (at  that  time  a  term  referring  primarily  to  motivational  potential,  personal 
presence/domination  and  emotional  calmness  under  stress).  Interviews  were  common  during  this 
period  and  were  usually  guided  by  an  applicant's  answers  to  a  paper-and-pencil  biographical 
inventory.  A  great  deal  of  research  dealing  with  personality  was  conducted  during  the  period 
from  1945  to  1970.  Some  of  this  research  showed  that  personality  inventories  could  accurately 
identify  psychiatrically  unsuitable  applicants,  but  did  not  distinguish  between  successful  and 
unsuccessful  aviation  cadets.  Sells  (1956)  found  that  motivational  factors  were  more  predictive 
of  long-term  success  as  a  pilot  than  of  training  perfonnance.  Prior  to  this,  some  countries  were 
already  screening  based  on  nonclinical  personality  traits.  Both  Israel  and  Denmark  screened  for 
nonauthoritarian,  egalitarian  leadership  style.  Many  European  countries  were  also  either  using  or 
evaluating  the  Defense  Mechanism  Test,  which  is  a  psychoanalytic  projective  instrument 
designed  to  measure  stress  tolerance. 
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selection  board  resulting  in  an  eligibility  rating.  Those  approved  by  the  board  are  sent  on  to 
medical  examination.  Once  a  year  a  final  selection  board  is  held  where  psychologists,  flight 
surgeons  and  pilot  officers  together  decide  on  a  final  ranking  order.  There  is  a  close  connection 
between  selection  and  training,  and  psychologists  do  follow-up  studies  on  all  stages  of  the  pilot 
training  as  a  way  of  getting  continuous  feedback  from  the  system  and  vice  versa,  thus  keeping 
updated  with  the  progress  of  each  individual  and  the  demands  that  are  placed  upon  them  during 
training.  The  level  of  attrition  during  training  is  low,  which  is  a  result  of  successful  selection 
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This  study  examined  the  ability  of  expert  clinical  psychologists  to  predict  advanced  flight 
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but  no  true  flight  screening  program  existed  until  the  Korean  War  with  the  advent  of  the 
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combined  with  tight  defense  budgets  to  force  the  Air  Force  to  turn  to  some  sort  of  flight 
screening  to  reduce  attrition  rates.  For  most  of  the  next  decade,  Air  Training  Command  (ATC) 
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continued  to  run  a  light  plane  screening  program;  but  the  introduction  of  the  T-37  and  the  all-jet 
training  program  in  1958  encouraged  Air  Force  officials  to  view  light  plane  screening  as 
counterproductive.  It  ended  two  years  later.  However,  the  war  in  Southeast  Asia  increased  the 
demand  for  pilots  again,  and  ATC  reintroduced  light  plane  screening,  which  continued  in  various 
forms  until  insurmountable  problems  with  the  T-3A  prompted  the  end  of  the  program  in  1997. 
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degree  of  standardization  and  uniformity.  As  the  Air  Force  faces  an  era  of  stressed  budgets, 
filling  its  ranks  with  those  who  will  earn  their  wings  is  imperative.  A  flourishing  flight  screening 
program  is  as  important  today  as  any  time  in  the  Air  Force‘s  history.  As  Air  Education  and 
Training  Command  embarks  on  yet  another  revision,  returning  to  the  philosophy  of  flight 
screening  before  flight  training,  it  is  instructive  to  examine  how  the  command  got  to  where  it  is 
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core  of  the  Air  Force ‘s  combat  capability. 
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explicit  the  link  between  the  tasks  selected  and  the  requirements  for  successful  pilot 
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capability  of  the  battery  to  predict  primary  training  grades  is  demonstrated.  Results  of 
discriminant  analysis  of  setbacks  and  attrition  should  be  viewed  with  caution. 
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Track  (IERW-MT)  and  became  operative  in  May  1988.  The  research  problem  for  the  U.S.  Anny 
Research  Institute  Aviation  R&D  Activity  (ARIARDA)  was  to  develop  tests  and  procedures  for 
selecting  aviator  candidates  for  one  of  four  helicopters  prior  to  training  day  100.  ARIARDA 
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were  considered  and  evaluated  for  their  potential  to  discriminate  among  aviators.  On  the  other 
hand,  groups  of  Subject  Matter  Experts  (SMEs)  developed  criticality-rated  aviator  candidate 
abilities  and  traits  for  specific  operational  helicopters.  Extensive  literature  reviews  and  liaison 
with  sister  services  and  other  agencies  were  accomplished.  Four  test  instruments  were  evaluated 
for  use.  The  underlying  abilities,  traits,  and  skills  these  batteries  purported  to  measure  matched 
the  abilities,  traits,  and  skills  identified  as  necessary  by  the  SMEs  for  each  of  their  helicopters. 
Upon  selection  of  the  subtests  contained  in  the  ARIARDA  experimental  test  battery,  high-time 
aviators  were  given  the  experimental  battery  to  develop  scoring  profiles  for  specific  aircraft  and 
to  generate  the  data  for  the  statistical  analyses  that  resulted  in  the  Preliminary  Multi-Track 
Classification  Algorithm. 
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Refractive  surgery  to  visually  rehabilitate  refractive  errors  of  the  eye  continues  to  evolve 
at  a  significant  pace  and  is  here  to  stay.  The  surgical  manipulation  of  the  cornea  by  carefully 
planned  incisions,  as  in  radial  keratotomy,  represented  the  first  procedure  to  evolve  for  the 
correction  of  ametropia  and  is  an  area  of  continued  active  development  and  improvement. 
However,  many  concerns  mitigate  against  this  procedure  in  the  aeromedical  arena.  More 
recently,  photorefractive  keratectomy  using  laser  technology  to  ablate  and  recontour  the  comeal 
surface  has  emerged  as  a  viable  modality.  This  paper  explores  the  aeromedical  factors 
surrounding  this  new  revolutionary  procedure  and  discusses  the  issues  relevant  to  evaluating  its 
applicability  to  the  modern  military  aviator  as  well  as  reviewing  results  of  the  latest  clinical  trials 
currently  in  progress.  The  goal  is  to  provide  the  aeromedical  community  with  the  fundamental 
information  required  to  formulate  aeromedical  decisions  and  policy-making  in  regard  to  a  new 
procedure  that  is  certain  to  have  tremendous  impact  on  the  selection  of  future  aircrew  candidates. 
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Given  the  increasing  complexity  of  modem  military  aircraft  and  the  high  costs  associated 
with  pilot  training,  the  Canadian  Forces  (CF)  has  been  examining  methods  of  improving  the 
assessment  and  selection  of  pilot  candidates.  Consistent  with  this  objective,  the  CF  has 
developed  and  is  evaluating  the  Canadian  Automated  Pilot  Selection  System  (CAPSS),  an 
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predictive  power  of  the  ASTB.  c)  Relationships  among  the  Spatial  Apperception  Test  (SAT)  and 
several  of  the  temporal  acuity  tests  indicate  that  temporal  factors  may  be  involved  in  SAT 
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empirically  constructed  MMPI  personality  disorder  scales  to  assess  these  DSM-III  Axis  II 
conditions,  but  adequate  outpatient  validation  remains  to  be  accomplished.  The  present  study, 
based  on  104  male  aviators  referred  to  a  consultation  service,  found  significant  (p  <  0.001) 
positive  correlations  in  nine  of  1 1  personality  disorder  scale  comparisons  between  the  MMPI  and 
the  Millon  Clinical  Multiaxial  Inventory  (MCMI) ,  a  test  that  attempts  to  more  closely 
correspond  to  the  criterion  of  the  DSM-III/DSM-III-R.  The  Antisocial  and  Compulsive 
personality  disorder  scales  failed  to  significantly  correlate.  The  MMPI  personality  disorder 
scales;  however,  did  not  significantly  identify  which  subjects  had  psychiatrically  noted 
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The  US  Army  Research  Faboratory  is  developing  the  Job  Assessment  Software  System 
(JASS).  JASS  is  a  computer  program  to  define  and  measure  human  aptitudes  required  to  do  a 
job.  A  person  familiar  with  the  job  (designer,  worker,  trainee,  etc.)  uses  JASS  by  answering 
-yes”  or  -no”  to  a  series  of  questions.  The  answers  identify  the  aptitudes  required.  For  each 
required  aptitude,  JASS  presents  a  7-point  scale  to  rate  the  aptitude  level.  JASS  is  based  on  the 
work  of  Dr.  Edwin  Fleishman  (Fleishman  &  Quaintance,  1984)  of  George  Mason  University. 

This  paper  will  describe  JASS  and  its  recent  applications  and  will  also  describe  current  and 
anticipated  efforts  to  further  develop  and  improve  the  JASS  tool. 
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prospective  applicants'  subsequent  performance  on  the  Armed  Forces  Qualification  Test 
(AFQT).  A  modified  version  of  the  CAST  software  was  used  in  60  recruiting  stations  across  the 
country  from  January  through  December  1985  to  collect  CAST  item-level  performance 
information.  Screening  test  data  were  matched  to  applicant  records  from  Military  Entrance 
Processing  Stations  to  obtain  ASVAB  scores  and  relevant  demographic  information.  The  cross- 
validated,  corrected  correlation  between  CAST  and  AFQT  scores  is  .83.  CAST’s  ability  to 
predict  important  AFQT  perfonnance  categories  and  Anny  Aptitude  Area  scores  was  also 
examined.  Alternative  subtest  lengths  were  evaluated  and  item  bank  characteristics  were 
described. 
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restriction  in  range,  the  cross-validated  validity  estimate  based  on  the  whole  sample  is  .86.  Race 
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Knapp,  D.  J.,  Waters,  B.  K.,  &  Heggestad,  E.  D.  (2002).  Investigations  Related  to  the 

Implementation  of  the  Assessment  of  Individual  Motivation  (AIM).  Alexandria,  VA: 

U.S.  Army  Research  Institute  for  the  Behavioral  and  Social  Sciences. 

Knappen,  T.  M.  (1920).  Wings  of  War.  New  York:  G.P.  Putnam's  Sons. 

Knoell,  D.  M.  (1956).  Relationships  between  attitudes  of  bomber  crews  in  training  and  their 

attitudes  and  performance  in  combat.  Randolph  Air  Force  Base,  TX:  Air  Force  Personnel 
and  Training  Research  Center. 

In  research  on  bomber  crew  training  and  proficiency,  an  effort  has  been  made  to  develop 
economical,  reliable,  and  valid  measures  of  attitudes  exhibited  in  various  situations,  and  to 
detennine  the  relationship  of  such  attitudes  to  crew  proficiency.  The  present  study  as  made  to 
assess  the  stability  of  crew  attitudes  from  the  training  to  the  combat  situation.  The  study  was 
designed  also  to  provide  additional  information  concerning;  (a)  relationships  found  in  an  analysis 
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Early  feedback  from  the  operation  of  Uninhabited  Air  Vehicles  (UAVs)  indicates  that 
improvements  in  the  operator  interface  aspects  of  these  emerging  systems  would  reap  significant 
gains  in  system  perfonnance  and  effectiveness.  This  applies  to  both  effective  control  of  UAVs  as 
well  as  management  of  data  and  dissemination  of  the  associated  information.  The  Canadian 
Forces  (CF)  is  pursuing  the  introduction  of  UAVs,  and  while  such  platforms  may  provide  an 
enonnous  amount  of  data,  the  management  of  data  to  support  effective  human  decision  making 
is  still  an  issue.  Various  levels  of  automation  have  been  suggested  as  a  way  of  addressing  the 
problem  including  Intelligent/Adaptive  Interfaces  (IAIs)  for  decision  support.  IAIs  are  intended 
to  manage  information  dynamically  and  provide  the  right  data  and  information  to  the  right 
people,  at  the  right  time,  to  support  effective  decision  making.  The  work  reported  in  this  paper 
investigated  the  efficacy  of  IAIs  in  an  operational  situation.  The  selected  environment  involved 
UAV  operations  in  support  of  counter  terrorist  activities  with  the  IAI  modelled  as  part  of  the 
UAV  tactical  workstations  of  a  modernized  CP  140  aircraft.  In  order  to  produce  an  analysis  of 
UAV  operations  which  are  relevant  to  CF  UAV  implementation  plans,  a  one  hour  mission 
scenario  was  developed  which  reflected  a  portion  of  the  upcoming  Canadian  Forces 
Experimentation  Centre  (CFEC)  Atlantic  Littoral  Intelligence,  Surveillance  and  Reconnaissance 
Experiment  (ALIX)  program.  In  order  to  facilitate  the  development  of  a  perfonnance  model 
implemented  in  an  Integrated  Perfonnance  Modelling  Environment,  a  Hierarchical  Goal 
Analysis  and  Operational  Sequence  Diagrams  were  prepared  for  the  scenario.  The  model  was  run 
in  two  modes:  one  assuming  the  operators  used  a  conventional  interface  and  the  second  assuming 
interface  automation  using  an  IAI.  The  difference  between  mission  activities  without  automation 
(IAI  OFF)  and  with  automation  (IAI  ON)  was  reflected  in  the  time  to  complete  critical  task 
sequences  and  in  other  measures  of  perfonnance.  It  was  concluded  that  the  operational  control  of 
UAVs  from  an  airborne  platform  was  a  complex  task  and  workload  increased  during  use  of 
multiple  disparate  UAV  assets.  The  use  of  a  workstation,  which  incorporates  an  IAI  mode, 
pennitted  operators  to  continue  working  under  high  time  pressure,  resulting  in  upper  level  goals 
being  achieved  in  reduced  time. 
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effects  of  degree  of  motion  upon  the  predictive  validity  of  flight  simulators.  Five  instrument  and 
five  contact  maneuvers  were  flown  in  the  simulator  followed  by  flight  in  a  Piper  Aztec  aircraft. 
Perfonnances  were  recorded  by  two  observers  and  the  interobserver  reliability  coefficients  were 
0.962  and  0.919  for  instrument  maneuvers  and  0.879  and  0.613  for  contact  maneuvers  in  the 
simulator  and  aircraft,  respectively.  The  condition  of  no  motion  resulted  in  greater  error  than  the 
other  two  groups  in  the  simulator,  but  there  were  no  significant  differences  in  the  aircraft. 
Correlations  of  aircraft  perfonnance  from  the  simulator  maneuvers  were  0.763  (no  motion), 

0.91 1  (sustained  motion),  and  0.651  (washout  motion).  Simulator  motion  did  not  result  in  better 
aircraft  perfonnance,  and  higher  predictive  validity  was  found  with  very  basic  sustained  motion. 
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In  this  article,  the  authors  propose  adding  the  aircrew  psychomotor  test  (APT)  to  the  Air 
Force  Officer  Qualifying  Test  (AFOQT;  Form  N)  in  an  effort  to  reduce  the  number  of  cadets 
who  fail  to  complete  flight  training.  The  APT  consists  of  two  psychomotor  tasks.  For  the  first 
task,  subjects  are  required  to  track  a  target  using  two  hand  controls.  The  second  task  introduces 
the  use  of  foot  pedals.  The  subjects  are  required  to  use  the  hand  controls  and  the  foot  pedals  to 
keep  a  cross  centered  on  the  crosshairs  that  split  the  screen  in  half.  Approximately  200  cadets 
from  the  Air  Force  Academy's  classes  of  1978  and  1979  were  administered  the  AFOQT  and  the 
APT.  They  were  ranked  according  to  their  scores  and  all  who  failed  to  score  above  the  cut-off 
score  were  identified.  All  subjects  were  allowed  to  participate  in  flight  training.  After  completion 
of  flight  training,  their  training  perfonnance  was  compared  with  their  scores  on  the  AFOQT  and 
the  APT.  Using  the  APT  as  the  screening  device,  9.3  percent  of  the  pilot-qualified  cadets  in  the 
class  of  1978  would  have  been  denied  access  to  pilot  training,  but  83  percent  of  these  cadets 
would  have  succeeded;  6.0  percent  of  the  class  of  1979  would  have  been  denied  training,  but 
91.6  percent  of  these  cadets  would  have  succeeded.  The  correlations  between  the  APT  scores  and 
UPT  pass/fail  were  -.04  (class  of  78)  and  -.09  (class  of  79).  Results  of  the  analyses  using  the 
AFOQT  were  approximately  the  same  as  those  obtained  using  the  APT.  Thus,  neither  the 
AFOQT  or  the  APT  discriminated  very  well  between  those  who  passed  flight  training  and  those 
who  did  not. 
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private  pilot  certificate  were  obtained.  Individual  needs  for  feedback  were  significant  factors  of 
perfonnance  in  the  BFITS  training  and  its  transfer  to  the  aircraft.  Because  of  the  interaction 
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present  study  was  the  relationship  of  the  various  cognitive  factors  to  the  rate  of  acquisition  of  the 
complex  aerial  maneuver.  Prior  to  the  introduction  of  the  complex  maneuver  all  subjects  were 
trained  to  criterion  level  on  four  basic  instrument  flight  maneuvers  (Koonce  &  McCloy,  1980). 
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criterion  perfonnance  as  the  dependent  variable.  Results  indicated  cognitive  factors  were  very 
significant  in  predicting  complex  maneuver  performance.  Additionally,  individually  tailoring  the 
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enhanced  predictive  capability. 
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This  study  examined  personality  differences  between  student  naval  aviators,  student 
naval  flight  officers  and  a  normative  college  sample  using  the  Tri-Dimensional  Personality 
Questionnaire  (TPQ).  The  TPQ  is  a  100  item  true-false  questionnaire  designed  to  assess  several 
adaptive  stimulus-response  characteristics  of  personality  proposed  by  an  integrated  biosocial 
theory  of  personality.  It  measures  three  dimensions:  Novelty  Seeking  (activation),  Harm 
Avoidance  (inhibition)  and  Reward  Dependence  (maintenance)  [these  dimensions  correspond  to 
the  dopamine,  serotonin  and  norepinephrine  neural  systems,  respectively].  The  authors 
hypothesized  that  personality  characteristics,  psychomotor  skills  and  cognitive  abilities  play  a 
significant  role  in  the  selection  of  aviation  as  a  career  goal.  Thus,  there  should  be  both 
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similarities  and  differences  in  personality  characteristics  between  pilots  and  flight  officers.  One 
hundred  twenty  nine  aviation  candidates  from  the  U.S.  Navy  flight  training  program  were  used 
as  subjects.  Seventy-nine  were  student  naval  aviators  and  50  were  student  naval  flight  officers. 
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flight  officers  are  likely  to  pursue  novel  and  unfamiliar  experiences  and  to  appear  calm  and 
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predict  undergraduate  pilot  training  outcomes.  Although  much  useful  research  has  been  done  in 
the  BAT  bahery,  the  need  for  additional  psychometric  research  to  improve  test  scoring 
procedures  and  predictive  efficiency  was  identified.  The  purpose  of  this  study  was  to  investigate 
(a)  the  internal  consistency  of  item-level  test  scores,  (b)  the  effects  of  alternative  scoring 
procedures  (e.g.,  treatment  of  outliers,  data  transfonnations,  alternate  scoring  algorithms)  on 
internal  consistency  and  validity,  and  (c)  the  factor  structure  of  the  BAT.  Results  showed  that  (a) 
internal  consistencies  of  most  BAT  scores  are  acceptable,  indicating  that  the  constructs  are  being 
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and  (e)  BAT  scores  can  be  combined  into  an  efficient  model  for  the  prediction  of  undergraduate 
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to  be  examined  in  relation  to  smoking.  Twenty-four  of  the  62  variables  had  significant 
correlations  (p  <.05)  with  CA,  and  16  showed  significant  relationships  to  CY.  Findings  are 
related  briefly  to  previous  research  and  problems  of  cause-effect  isolation  are  mentioned.  It  is 
concluded  that  results  in  general  support  of  previous  findings  on  smoker-nonsmoker  differences. 
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This  article  examines  whether  measures  of  certain  personality  constructs  can  predict  pilot 
involvement  in  accidents.  The  author  makes  the  assumption  that  there  is  not  a  unitary  set  of 
noncognitive  measures  that  make  one  more  likely  to  be  involved  in  accidents.  Rather,  there  may 
be  some  personal  characteristics  that,  depending  on  the  circumstances,  predispose  one  person 
more  than  another  to  engage  in  behaviors  that  increase  the  probability  that  he  or  she  will  be 
involved  in  an  accident.  Specifically,  the  author  attempts  to  answer  the  question  of  whether  or 
not  there  are  personality,  motivational  and/or  other  psychological  variables  associated  with 
behavioral  responses  that,  under  various  circumstances,  are  more  or  less  likely  to  result  in 
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instrument  measures  16  source  or  primary  factors  and  eight  secondary  factors  (in  addition  to 
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selecting  and  classifying  soldiers  into  military  occupational  specialties.  Tasks  1  and  2  of  the 
project  are  documented  in  this  report.  More  specifically,  this  document  contains  descriptions  of 
the  selection  and  job  assignment  processes  in  the  Army,  Navy,  Marine  Corps,  and  Air  Force  in 
terms  of  their  intended  design  and  operational  reality.  Subsequent  to  the  description  of  current 
military  selection  and  classification  systems,  alternative  models  are  presented  and  evaluated 
along  numerous  qualitative  dimensions. 
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Pilot  selection  in  the  Canadian  Armed  Forces  has  been  a  continuing  concern  especially 
since  attrition  rates  for  trainees  has  been  as  high  as  fifty  percent  on  a  few  courses.  In  the  reported 
study,  the  utility  of  a  custom-developed,  microprocessor-driven  aircraft  landing  test  WT),  was 
examined  in  terms  of  its  added  value  to  the  current  pilot  selection  battery.  A  CROMENCO  II 
microcomputer  was  programmed  to  simulate  the  landing  of  a  light  aircraft  where  visual 
stimulation  was  presented  on  a  CRT  and  the  candidates  used  a  -joystick”  and  throttle  to  perfonn 
three  landing  tests.  Several  dependant  measures  were  automatically  recorded  every  500  m  sec. 
This  ALT  was  a  further  development  of  earlier  research  conducted  on  another  system.  (Fowler, 
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1981).  One  hundred  and  fifty  male  candidates  applying  for  military  flying  training  were  tested  on 
the  ALT  as  well  as  on  the  current  test  battery  which  consists  of  a  psychomotor  test  in  an  aviation 
tester,  pencil-and-paper  tests  which  tape  verbal  and  quantitative  aptitudes  and  a  memory  test. 

The  candidates  also  completed  a  measure  of  cognitive  style,  the  Group  Embedded  Figures  .Test, 
and  selected  scales  from  Jackson‘  s  Personality  Research  Form.  It  was  found  that  performance 
on  the  ALT  was  independent  of  performance  on  the  current  test  battery  as  well  as  performance 
on  the  Group  Embedded  Figures  Test  and  the  selected  scales  from  Jackson‘s  Personality 
Research  Fonn.  Future  research  into  the  use  of  the  ALT  as  a  selection  device  will  take  place 
once  trainees  have  completed  the  primary  flying  training  course. 
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The  author  discusses  the  increasing  dependability  and  reliability  of  aircrafts  and  how  this 
has  made  the  role  of  the  human  operator  much  more  critical.  One  effort  to  identify  individual 
attributes  that  are  important  to  aviation  safety  has  been  the  delineation  of  five  hazardous  thought 
patterns  (HTPs):  anti-authority,  impulsivity,  invulnerability,  macho  and  resignation.  These  HTPs 
are  thought  to  have  the  status  of  constructs  and  are  seen  as  mediating  the  link  between  basic 
psychological  processes  and  irrational  pilot  judgment.  Even  though  there  is  basically  no  validity 
research  on  these  HTPs,  they  are  a  core  element  of  the  judgment  training  currently  being 
conducted  by  several  U.S.  and  Canadian  airlines.  The  purpose  of  this  study  was  to  examine  the 
construct  validity  of  these  HTPs  using  the  16  PF  and  Rotter's  Locus  of  Control  scale.  Thirty-five 
male  pilots  participated  (4  held  commercial  ratings  and  3  1  had  private  licenses).  Subjects 
completed  three  scales  from  the  16  PF  (impulsivity,  superego  strength  and  integration  self- 
concept  control)  and  the  Rotter  Locus  of  Control  scale.  They  also  completed  a  self-assessment 
inventory  designed  to  measure  the  five  HTPs.  When  completing  this  inventory,  subjects 
represented  with  10  flight  scenarios  that  describe  errors  in  pilot  judgment  and  asked  to  rank 
(from  most  probable  to  least  probable)  the  reasons  why  they  might  have  made  the  error.  Results 
showed  that  fourteen  of  the  subjects  did  not  have  a  predominant  HTP,  but  the  percentage  of 
pilots  showing  a  single  dominant  HTP  was  similar  to  that  found  in  later  studies  (e.g.,  Lester  & 
Connolly,  1987).  Of  the  remaining  subjects,  43  percent  primarily  exhibited  the  invulnerability 
HTP,  impulsivity  was  dominant  in  20  percent  and  macho  was  dominant  in  14  percent.  The 
remaining  HTPs  were  predominant  in  only  a  few  subjects.  An  analysis  of  variance  (ANOVA) 
revealed  a  significant  relationship  between  the  three  HTPs  and  the  integration  self-concept 
control  scale  and  Rotter's  locus  of  control  scale.  Pilots  with  the  invulnerable  HTP  scored 
significantly  lower  on  the  integration  scale  and  pilots  with  the  macho  HTP  scored  significantly 
higher  on  the  integration  scale.  Also,  pilots  with  the  dominant  macho  HTP  were  significantly 
more  internally  controlled  than  either  the  invulnerable  or  impulsive  pilots.  The  authors  conclude 
that  this  study  provides  some  support  for  the  construct  validity  of  the  HTPs,  but  notes  that  their 
sample  was  extremely  small. 
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The  authors  state  that  errors  in  pilot  decision-making  (PDM)  can  be  accounted  for  by  five 
hazardous  thought  patterns  (HTPs):  anti-authority,  impulsivity,  invulnerability,  macho  and 
resignation.  However,  the  evidence  for  these  HTPs  is  largely  anecdotal  and  their  exact  nature  is 
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not  very  clear.  For  example,  some  researchers  consider  them  to  be  attitudes,  while  others 
consider  them  to  be  personality  variables.  This  study  was  conducted  with  five  purposes:  (1) 
establish  base  rates  for  the  different  HTPs;  (2)  examine  the  relationships  among  the  HTPs;  (3) 
detennine  how  the  HTPs  are  related  to  pilot  personality;  (4)  detennine  whether  the  HTPs  are 
related  to  involvement  in  aviation  accidents  and  incidents;  and  (5)  examine  the  utility  of  two 
forms  of  the  Pilot  Decision  Making  Questionnaire  (PDMQ).  One  hundred  fifty- two  males  in 
their  late  teens  or  early  twenties  (all  pilots)  were  used  as  subjects  in  this  study.  They  had  an 
average  of  190  flight  hours.  Subjects  completed  the  Rotter  Locus  of  Control  Scale,  four  scales 
from  the  16  PF  (Emotional  Stability,  Surgency,  Conscientiousness  and  Integration)  and  two 
forms  of  the  PDMQ.  In  the  PDMQ  Form  A,  subjects  are  presented  with  scenarios  and  asked  to 
indicate  whether  the  pilot's  behavior  was  "very  much  like  me"  or  "not  at  all  like  me."  This  is 
designed  to  be  a  measure  a  subject's  overall  propensity  toward  irrational  judgment.  The  PDMQ 
Form  P  describes  irrational  decisions  and  presents  the  subjects  with  reasons  (each  representing  a 
HTP)  for  why  that  pilot  behaved  as  he  or  she  did.  Subjects  are  asked  to  rate  how  likely  it  was 
that  each  of  the  reasons  would  have  caused  the  pilot  to  behave  in  that  manner.  This  was  designed 
to  measure  the  strength  of  each  of  the  HTPs.  These  data  were  analyzed  and  subjects  were 
classified  according  to  their  predominant  HTP  (39%-Invulnerable,  24%-Impulsive,  19%-Macho, 
very  few-Resignation,  0%  Anti -Authority).  HTP  intercorrelations  ranged  from  .21  to  .53  and  all 
were  positive.  Subjects  who  displayed  the  Macho  HTP  were  significantly  more  internally 
controlled  than  subjects  who  displayed  the  Invulnerable  or  Impulsive  HTPs.  They  were  also 
more  Conscientious  than  those  classified  as  Invulnerable.  No  other  significant  differences  among 
the  groups  were  found.  Subjects  were  separated  into  groups  with  "better"  and  "poorer"  judgment 
on  the  basis  of  their  scores  on  the  PDMQ  Form  A.  Pilots  with  better  judgment  were  more 
internally  controlled  and  were  better  integrated  than  those  with  poorer  judgment.  No 
relationships  were  found  between  scores-on  the  PDMQ  Fonn  A  and  involvement  in  aviation 
accidents/incidents. 
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The  extensive  World  War  II  research  on  the  Aviation  Cadet  Classification  Battery  has 
been  reported  in  the  Army  Air  Forces  Psychology  Program  Research  Reports  (2,  3,  4).  This 
article  proposes  to  summarize  major  findings  of  postwar  research  in  pilot  selection  and 
classification  in  the  United  States  Air  Force  (1,5). 

Levine,  J.  B.,  Lee,  J.  O.,  Ryman,  D.  H.,  &  Rahe,  R.  H.  (1976).  Attitudes  and  accidents  aboard  an 

aircraft  carrier.  Aviation,  Space,  and  Environmental  Medicine,  47,  82-85. 

This  article  examines  the  relationships  between  behavioral  attitudes  and  accidents  for 
aviators  and  enlisted  air  wing  support  personnel  aboard  an  aircraft  carrier.  One  hundred  fifty-six 
aviators  and  879  support  personnel  participated  in  this  study.  These  subjects  completed  a  22 -item 
attitude  questionnaire  which  asked  them  to  rate  the  extent  to  which  they  agreed  or  disagreed  with 
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each  statement.  The  questionnaire  was  factor  analyzed  (varimax  rotation)  and  items  loading  most 
highly  on  each  factor  were  summed  to  fonn  six  scales:  logic,  adventurousness,  discipline, 
concern  with  self  and  brashness.  The  accident  criterion  was  the  number  of  personal  injuries  (or 
deaths)  which  were  sufficiently  severe  to  require  a  visit  to  sick  call.  Results  showed  that  the 
Adventurousness  scale  was  significantly  correlated  with  personal  injuries  among  the  enlisted  air 
crew  personnel  (r  =  .  12,  p  <  .01)  and  with  aircraft  accidents  among  aviators  (r  =  .25,  p  <  .01). 
None  of  the  other  five  factor-analytically  derived  scales  were  correlated  with  accidents  for  either 
sample. 
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A  common  goal  of  many  clinical  research  studies  is  the  development  of  a  reliable  clinical 
decision  rule,  which  can  be  used  to  classify  new  patients  into  clinically-important  categories. 
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MASS  accounts  for  every  activity  in  pilot  training  as  well  as  a  subjective  input  from  the 
instructors  as  to  the  overall  attitude  and  perfonnance  of  the  student.  The  score  obtained  from  the 
MASS  is  categorical  by  assigning  a  weighting  to  a  particular  category  of  performance.  Currently, 
there  is  no  direct  link  between  the  skills  needed  to  fly  modem  fighter  aircraft  and  the  MASS. 
Additionally,  many  of  the  skills  learned  in  pilot  training  span  multiple  categories  and  it  is 
possible  for  a  deficiency  to  be  buried  in  the  MASS  score.  The  goal  of  this  research  was  to 
identify  the  core  skills  required  to  fly  the  various  fighter  aircraft  through  the  use  of  a  Combat  Air 
Forces  (CAF)  wide  survey  instrument,  interviews,  and  working  group  inputs.  An  assignment 
model  was  created  with  a  focus  on  assigning  students  based  on  skill  strengths.  After  the  core 
skills  were  identified  and  related  to  UPT  events,  a  value  hierarchy  was  created  and  a  model 
developed  to  identify  the  best  aircraft  fit  for  a  student  based  on  their  performance  as  related  to 
the  skill  sets.  This  paper  frames  the  issues,  outlines  the  methodology  used  to  define  the  skill  sets, 
and  discusses  the  development  of  the  model.  Finally,  recommendations  are  made  on  future 
changes  to  MASS,  the  UPT  student  assignment  process,  and  the  pilot  training  syllabus. 
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of  a  trial.  The  results  pointed  to  the  usefulness  of  both  flash  and  color  task  performance  as 
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This  chapter  focuses  on  the  selection  and  training  of  people  who  work  in  aviation 
specialties.  Aviation  work  encompasses  a  full  spectrum  of  activity  from  operators  of  aircraft  (ie 
pilots),  to  flight  attendants,  dispatchers,  flight  controllers,  mechanics,  engineers,  baggage 
handlers,  ticket  agents,  airport  managers,  and  air  marshals.  The  topic  covers  a  lot  of  territory.  For 
manageability,  we  concentrated  on  three  categories  of  aviation  personnel:  pilots  and  aircrew, 
maintenance  technicians,  and  flight  controllers.  One  problem  shared  by  nearly  all  aviation 
specialties  is  their  workload.  Workload  within  most  categories  of  aviation  work  has  been 
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under  these  conditions  than  later  boms. 

Prunkl,  P.  R.,  &  Boyles,  W.  R.  (1968).  A  preliminary  application  of  the  critical  incident 

technique  to  combat  performance  of  Army  aviators.  Paper  presented  at  the  Alabama 
Psychological  Association  Annual  Meeting,  Binningham,  AL. 

The  research  being  reported  in  this  paper  was  an  effort  by  Division  No.  6  (Aviation)  of 
the  Human  Resources  Research  Office,  to  describe  the  ways  in  which  ineffective  aviators  cope 
with  combat  stress.  It  was  thought  that  by  focusing  attention  on  the  behavior  of  men  judged 
ineffective  in  combat,  we  could  begin  developing  measures  of  overall  aviation  combat 
effectiveness.  In  designing  a  preliminary  study  of  this  kind,  we  chose  a  methodology  that 
provided  rich  and  detailed  information  of  the  combat  environment  of  Vietnam  and  aviators’ 
reactions  to  it. 

Quebe,  J.  C.  (1985).  The  effects  of  the  flight  screening  program  on  attrition  in  undergraduate 
pilot  training.  Paper  presented  at  the  27th  Annual  Military  Testing  Association 
Conference,  San  Diego,  CA. 

Air  Force  commissioned  officer  and  Officer  Training  School  (OTS)  pilot  training 
candidates  who  do  not  have  a  Private  Pilot's  License  are  required  to  complete  a  Flight  Screening 
Program  (FSP).  FSP  is  a  14-hour  flying  program  in  the  T-41  (Cessna  172).  All  student  sorties  are 
graded  by  the  Instructor  Pilot  (IP).  Students  perfonning  especially  poorly  may  be  eliminated 
before  completion  of  the  program.  After  12  flying  hours,  students  are  administered  Final 
Evaluation  Flight  covering  the  basic  flying  skills  taught.  Students  failing  this  evaluation  may 
repeat  it  one  time.  Students  achieving  a  satisfactory  Final  Evaluation  Flight  grade  proceed  to 
Undergraduate  Pilot  Training  (UPT).  All  other  students  are  eliminated  from  the  pilot  training 
program  for  flying  training  deficiency  (FTD).  Thus,  the  program  acts  as  a  screen  for  entry  to 
WT. 

Rabin,  J.  (1996).  Correction  of  subtle  refractive  error  in  aviators.  Aviation,  Space,  and 
Environmental  Medicine,  67(2),  161-164. 

Optimal  visual  acuity  is  a  requirement  for  piloting  aircraft  in  military  and  civilian 
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settings.  While  acuity  can  be  corrected  with  glasses,  spectacle  wear  can  limit  or  even  prohibit  use 
of  certain  devices  such  as  night  vision  goggles,  helmet  mounted  displays,  and/or  chemical 
protective  masks.  Although  current  Army  policy  is  directed  toward  selection  of  pilots  who  do  not 
require  spectacle  correction  for  acceptable  vision,  refractive  error  can  become  manifest  over 
time,  making  optical  correction  necessary.  In  such  cases,  contact  lenses  have  been  used  quite 
successfully.  Another  approach  is  to  neglect  small  amounts  of  refractive  error,  provided  that 
vision  is  at  least  20/20  without  correction.  This  report  describes  visual  findings  in  an  aviator  who 
was  fitted  with  a  contact  lens  to  correct  moderate  astigmatism  in  one  eye,  while  the  other  eye, 
with  lesser  refractive  error,  was  left  uncorrected.  Advanced  methods  of  testing  visual  resolution, 
including  high  and  low  contrast  visual  acuity  and  small  letter  contrast  sensitivity,  were  used  to 
compare  vision  achieved  with  full  spectacle  correction  to  that  attained  with  the  habitual,  contact 
lens  correction.  Although  the  patient  was  pleased  with  his  habitual  correction,  vision  was 
significantly  better  with  full  spectacle  correction,  particularly  on  the  small  letter  contrast  test. 
Implications  of  these  findings  are  considered. 

Rankin,  W.  C.,  &  McDaniel,  W.  C.  (1981).  Aviation  training  task  proficiency:  A  probabilistic 
approach.  Paper  presented  at  the  23rd  Annual  Military  Testing  Association  Conference, 
Arlington,  VA. 

Detennination  of  the  proficient  performance  of  aircraft  flying  tasks  continues  to  be  a 
subjective  judgment  made  by  instructor  pilots.  Current  practice  in  training  squadrons  consists  of 
"flights"  during  which  a  subset  of  tasks  from  the  training  syllabus  are  perfonned  a  varying 
number  of  times  by  the  pilot  trainee  at  the  discretion  of  the  instructor  pilots.  During  or  shortly 
after  each  flight,  the  instructor  pilot  "grades"  the  pilot  trainee  on  the  tasks  performed  using  a 
standard  scale  but  also  employing  his  own  personal  criteria.  While  instructors  differ  in  their 
personal  rating  bias  (hard-easy),  they  attempt  to  grade  in  terms  of  "average  performance  at  this 
stage  of  training."  It  is  usual  for  the  pilot  trainee  to  be  exposed  to  several  different  instructor 
pilots.  After  a  specified  minimum  number  of  flights,  and  a  recommendation  by  an  instructor 
pilot,  the  pilot  trainee  is  scheduled  for  a  final  "check  flight.  His  performance  on  selected  tasks  is 
graded  by  an  instructor  pilot  acting  in  the  independent  role  of  "check  pilot."  Should  the  pilot 
trainee  not  perfonn  the  flight  consonant  with  the  standards  of  perfonnance  expected  of  him  by 
the  "check  pilot,"  he  is  rescheduled  for  additional  "check  flights"  until  he  is  deemed  proficient. 
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As  a  review  of  the  existing  knowledge  of  the  psychology  of  aviation  the  present  paper 
has  a  number  of  limitations.  First,  it  does  not  include  the  significant  research  that  has  been  done 
in  this  country  in  the  last  year  and  a  half  under  the  auspices  of  the  Committee  on  Selection  and 
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Training  of  Aircraft  Pilots  of  the  National  Research  Council  and  the  Civil  Aeronautics  Authority. 
Secondly,  there  is  good  reason  to  believe  that  some  important  work,  particularly  in  Gennany  and 
Russia,  is  not  being  published.  Thirdly,  much  of  the  Russian  published  material,  a  considerable 
amount  of  the  Italian,  and  even  some  in  the  more  accessible  languages  could  not  be  examined  in 
time  for  the  present  paper.  Nevertheless,  the  writers  have  in  their  possession  626  abstracted 
references  that  bear  upon  the  psychology  of  aviation,  and  92  of  these  titles  have  been  selected  for 
mention  here. 
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Graf. 
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Ree,  M.  (2003).  Test  of  Basic  Aviation  Skills  (TBAS)  incremental  validity  beyond  Air  Force 
Officer  Qualifying  Test  pilot  composite  for  predicting  pilot  criteria.  San  Antonio,  TX: 
Operational  Technologies  Corporation. 

Ree,  M.  J.  (1976).  Effects  of  item-option  weighting  on  the  reliability  and  validity  of  the  AFOQT 
for  pilot  selection.  Lackland  Air  Force  Base,  TX:  Air  Force  Human  Resources 
Laboratory. 

Ree,  M.  J.  (2003).  Test  of  Basic  Aviation  Skills  (TBAS):  Scoring  the  tests  and  compliance  of  the 
tests  with  the  standards  of  the  American  Psychological  Association.  San  Antonio,  TX: 
Operational  Technologies  Corporation. 
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Ree,  M.  J.,  &  Carretta,  T.  R.  (1992).  The  correlation  of  cognitive  and  psychomotor  tests.  Brooks 
Air  Force  Base,  TX:  Armstrong  Laboratory. 

A  paper-and-pencil  multiple-aptitude  test  battery  and  a  computer-based  psychomotor  test 
battery  were  administered  to  a  sample  of  354  Air  Force  recruits  .  The  tests  of  the  multiple- 
aptitude  battery  were  used  estimate  psychometric  g  and  to  predict  the  psychomotor  tests.  The 
multiple  correlation  of  the  multiple-aptitude  tests  and  each  psychomotor  test  as  a  criterion  was 
SO,  corrected  for  range  restriction  .  The  average  correlation  of  a  psychomotor  tests  and 
psychometric  g,  corrected  for  range  restriction  and  unreliability  ,  was  .73.  The  multiple-aptitude 
tests  and  the  psychomotor  tests  were  correlated  and  subjected  to  a  principal  components  analysis. 
The  average  saturations  of  the  psychomotor  and  multiple-aptitude  tests  were  .76  and  .87, 
respectively  .  Confirmatory  factor  analyses  disclosed  hierarchical  general  cognitive  and  general 
psychomotor  factors,  two  lower  order  multiple-aptitude  test  factors  and  three  lower  order 
psychomotor  test  factors. 
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Journal  of  Aviation  Psychology,  6(2),  111-123. 

Examines  the  role  of  general  cognitive  ability  (g)  in  the  selection  of  military  pilots. 
Presentation  of  the  brief  history  of  the  use  of  G  in  pilot  selection;  Measurement  of  g;  Awareness 
of  the  prominence  of  g  in  job  perfonnance.  1  Examines  the  role  of  general  cognitive  ability  (g)  in 
the  selection  of  military  pilots.  Presentation  of  the  brief  history  of  the  use  of  G  in  pilot  selection; 
Measurement  of  g;  Awareness  of  the  prominence  of  g  in  job  perfonnance. 

Ree,  M.  J.,  &  Carretta,  T.  R.  (1997).  What  makes  an  aptitude  test  valid?  In  R.  F.  Dillion  (Ed.), 
Handbook  on  Testing  (pp.  65-81).  Westport,  CT:  Greenwood  Press. 

Ree,  M.  J.,  &  Carretta,  T.  R.  (1998).  Computerized  testing  in  the  United  States  Air  Force. 
International  Journal  of  Selection  and  Assessment,  6(2),  82-106. 

Ree,  M.  J.,  &  Carretta,  T.  R.  (1998).  Interchangeability  of  Verbal  and  Quantitative  Scores  for 
Personnel  Selection:  An  Example.  Brooks  Air  Force  Base,  TX:  Air  Force  Research 
Laboratory. 

Ree,  M.  J.,  Carretta,  T.  R.,  &  Teachout,  M.  S.  (1995).  Role  of  ability  and  prior  job  knowledge  in 
complex  training  performance.  Journal  of  Applied  Psychology,  80(6),  721-730. 

A  causal  model  of  the  role  of  general  cognitive  ability  and  prior  job  knowledge  in 
subsequent  job-knowledge  acquisition  and  work-sample  performance  during  training  as 
developed.  Participants  were  3,428  U.S.  Air  Force  officers  in  pilot  training.  The  measures  of 
ability  and  prior  job  knowledge  came  from  the  Air  Force  Officer  Qualifying  Test.  The  measures 
of  job  knowledge  acquired  during  training  were  derived  from  classroom  grades.  Work-sample 
measures  came  from  check  flight  ratings.  The  causal  model  showed  that  ability  directly 
influenced  the  acquisition  of  job  knowledge.  General  cognitive  ability  influenced  work  samples 
through  job  knowledge.  Prior  job  knowledge  had  almost  no  influence  on  subsequent  job 
knowledge  but  directly  influenced  the  early  work  sample.  Early  training  job  knowledge 
influenced  subsequent  job  knowledge  and  work-sample  perfonnance.  Finally,  early  work-sample 
perfonnance  strongly  influenced  subsequent  work-sample  performance. 

Ree,  M.  J.,  &  Earles,  J.  A.  (1990).  Differential  validity  of  a  differential  aptitude  test.  Brooks  Air 
Force  Base,  TX:  Air  Force  Human  Resource  Laboratory. 

Two  studies  were  conducted  to  examine  the  role  of  general  and  specific  ability  in 
predicting  performance  in  military,  technical  training.  The  first  was  a  principal  components 
analysis  of  the  Anned  Services  Vocational  Aptitude  Battery  (ASVAB);  the  second  was  a  series 
of  regression  analyses  using  principal  component  scores  derived  from  test  scores  as  predictors 
and  final  school  grades  from  Air  Force  technical  training  as  the  criterion.  In  the  first  study,  10 
principal  components  were  derived  using  a  nation-wide  representative  sample  of  American 
youth.  Weights  derived  from  this  analysis  were  used  to  compute  principal  component  scores  for 
over  78,000  subjects  in  Air  Force  technical  training  in  89  jobs.  The  first  principal  component 
was  a  general  ability  factor  (g).  Some  specific  ability  components  were  also  interpreted.  The 
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subjects  for  the  second  study  were  approximately  78,000  airmen  who  had  taken  parallel  fonns  of 
the  ASVAB  and  completed  technical  training.  Using  Final  School  Grade  as  the  criterion, 
multiple  regressions  were  computed  to  determine  if  g  was  a  potent  predictor  for  all  jobs  and  if 
predictive  accuracy  would  increase  if  other  principal  components,  measures  of  specific  abilities, 
were  added  to  the  prediction.  The  regressions  were  computed  from  both  uncorrected  and 
corrected  correlation  matrices  to  properly  estimate  the  R2  values.  For  each  of.  the  89  jobs,  the 
first  principal  component,  g,  was  the  most  potent  predictor,  and  for  i,9  of  the  jobs,  additional 
principal  components  increased  the  coefficient  of  multiple  correlation.  The  magnitude  of  the 
increase  in  R2  was  estimated  to  be  about  .022  on  average.  Although  this  may  seem  small, 
practical  benefits  could  be  realized  when  applied  to  large  groups  of  individuals  such  as 
applicants  for  military  service. 

Reece,  R.  H.  (1919).  Night  Bombing  With  the  Bedouins.  Boston:  Houghton  Mifflin  Co. 

Regan,  J.  E.  (1982).  Short-term  memory  and  dual  task  performance.  Paper  presented  at  the  26th 
Annual  Meeting  of  the  Human  Factors  Society. 

The  concept  of  short-term  memory  as  a  limited  capacity  structure  is  embedded  within 
information  processing  approaches  in  psychology.  As  a  consequence,  short-term  memory  tasks 
have  been  employed  as  attention  loading  devices  in  studies  of  dual  task  perfonnance  (Logan, 
1979).  The  assumption  behind  such  studies  is  that  the  memory  task  will  load  the  information 
processing  system  and  will  usurp  processing  capacity  and/or  space  in  the  central  structure. 
Perfonnance  on  the  non-memory  task  is  examined  to  see  if  processing  stages  of  that  task  draw  on 
the  same  capacity  or  space  as  the  memory  task.  This  paper  considers  two  hypotheses  about  how 
short-term  memory  might  interact  with  another  task  in  a  dual  task  situation.  When  two  tasks  are 
combined,  the  activity  of  controlling  and  organizing  perfonnance  on  both  tasks  simultaneously 
may  compete  with  either  task  for  a  resource,  be  that  resource  space  in  a  central  mechanism, 
general  processing  capacity,  or  some  task  specific  resource.  If  there  is  some  special  relationship 
between  short-term  memory  and  control,  especially  if  there  is  an  identity  relationship  between 
short  term  and  a  central  controlling  mechanism,  then  short-term  memory  performance  should 
show  a  decrement  in  a  dual  task  situation.  Even  if  short-tenn  memory  does  not  have  any 
particular  identity  with  a  controlling  mechanism,  but  both  tasks  draw  on  some  common 
resource(s),  then  a  tradeoff  between  the  two  tasks  in  allocation  of  resources  is  possible,  and 
could  be  reflected  in  perfonnance. 
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Aerospace  Medicine  Directorate. 
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Stuff.  Multivariate  Behavioral  Research,  22(4),  383. 

Retzlaff,  P.  D.,  &  Gibertini,  M.  (1998).  Objective  psychological  testing  of  U.S.  Air  Force 

officers  in  pilot  training.  Aviation,  Space,  and  Environmental  Medicine,  59,  661-663. 

The  authors  reviewed  the  literature  pertaining  to  the  use  of  psychological  testing  with  Air 
Force  pilots  and  conclude  that  many  of  the  instruments  that  have  been  used  are  not 
psychometrically  sound  and  were  used  in  an  inappropriate  manner.  For  example,  they  point  out 
that  the  often  used  Minnesota  Multiphasic  Personality  Inventory  (MMPI)  was  developed  over  40 
years  ago  and  normed  on  psychiatric  patients.  They  advocate  the  use  of  three  tests  that  they 
believe  adequately  measure  a  broad  range  of  cognitive,  personality  and  psychopathological 
domains.  The  first  of  these  tests  is  the  Multidimensional  Aptitude  Battery  (MAB)  which  is  a  test 
of  intellectual  ability  based  largely  on  the  WAIS-R.  Verbal  components  include  infonnation 
comprehension,  arithmetic,  similarities  and  vocabulary.  Perfonnance  measures  include  digit 
symbol  coding,  picture  completion,  spatial  thinking,  picture  arrangement  and  object  assembly. 
The  Personality  Research  Form  (PRF;  Form  E)  measures  normal  personality  characteristics  and 
has  352  true-false  items,  organized  into  21  scales.  The  following  are  some  of  the  traits  measured: 
achievement,  aggression,  autonomy,  dominance,  harm  avoidance,  impulsivity  and  social 
recognition.  The  Millon  Clinical  Multiaxial  Inventory  (MCMI)  is  a  20-scale  instrument  designed 
to  measure  dimensions  associated  with  psychiatric  diagnoses.  The  MCMI  assesses  eight  basic 
personality  patterns,  three  pathological  personality  patterns  and  nine  clinical  syndromes.  The 
sample  used  in  this  study  consisted  of  350  white  males  entering  Undergraduate  Pilot  Training 
(UPT).  For  the  MAB,  the  subjects  had  an  average  full  scale  IQ  of  120,  with  an  average  verbal  IQ 
of  1 17  and  an  average  perfonnance  score  of  121.  Most  subjects  scored  above  the  MAB 
nonnative  sample.  For  the  PRF,  the  pilots  scored  higher  than  college  students  on  affiliation, 
cognitive  structure,  dominance  and  social  desirability.  They  scored  lower  than  college  students 
on  abasement,  autonomy,  harm  avoidance  and  understanding.  The  authors  pointed  out  that  this 
could  be  a  result  of  differences  in  age,  education,  or  other  moderators  between  student  pilots  and 
college  students.  The  MCMI  pointed  to  histrionic  and  narcissistic  patterns  personality  in  the 
student  pilots.  The  authors  note  that  this  is  in  line  with  the  lay  perception  of  the  pilot  as  highly 
sociable  and  having  strong  self  esteem. 
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retention:  A  ten  year  follow-up  on  psychological  testing.  In  A.  Laboratory  (Ed.).  Brooks 
AFB,  TX:  U.S.  Air  Force  Annstrong  Laboratory. 
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Laboratory  Aviation  Personality  Survey:  Development,  Norming,  and  validation. 

Military  Medicine,  167(12),  1026-1032. 

This  work  describes  the  development  of  a  new  psychological  test  for  aviators.  The 
Annstrong  Laboratory  Aviation  Personality  Survey  was  developed  through  the  integration  of 
clinical  theory,  psychometric  methods,  and  empirical  testing.  It  is  currently  given  to  all  incoming 
U.S.  Air  Force  pilot  candidates.  Using  a  sample  of  6,047  student  pilots,  a  thorough  test 
development  plan  was  accomplished.  The  15  final  test  scales  assess  personality, 
psychopathology,  and  crew  interaction  styles.  The  scales  have  nonnative  data  and  are 
demonstrated  to  be  reliable  and  valid.  The  Annstrong  Laboratory  Aviation  Personality  Survey  is 
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ground  cooperation  provides  some  of  the  answers  to  the  questions  posed  above  and  is  also 
indicative  of  the  difficulty  in  actually  institutionalizing  the  organizational,  training,  and  doctrinal 
changes  necessary  to  make  an  interdependent  land  and  air  force.  This  will  be  hard  work. 
Understanding  the  implications  of  creating  a  truly  interdependent  force  capable  of  withstanding 
the  pressures  of  the  next  inter-war  period  is  the  first  step. 

Robertson,  I.  T.,  &  Smith,  M.  (2001).  Personnel  selection.  Journal  of  Occupational  and 
Organizational  Psychology,  74,  441-472. 

The  main  elements  in  the  design  and  validation  of  personnel  selection  procedures  have 
been  in  place  for  many  years.  The  role  of  job  analysis,  contemporary  models  of  work 
perfonnance  and  criteria  are  reviewed  critically.  After  identifying  some  important  issues  and 
reviewing  research  work  on  attracting  applicants,  including  applicant  perceptions  of  personnel 
selection  processes,  the  research  on  major  personnel  selection  methods  is  reviewed.  Recent  work 
on  cognitive  ability  has  confirmed  the  good  criterion-  related  validity,  but  problems  of  adverse 
impact  remain.  Work  on  personality  is  progressing  beyond  studies  designed  simply  to  explore 
the  criterion-related  validity  of  personality.  Interview  and  assessment  centre  research  is 
reviewed,  and  recent  studies  indicating  the  key  constructs  measured  by  both  are  discussed.  In 
both  cases,  one  of  the  key  constructs  measured  seems  to  be  generally  cognitive  ability.  Biodata 
validity  and  the  processes  used  to  develop  biodata  instruments  are  also  critically  reviewed.  The 
article  concludes  with  a  critical  evaluation  of  the  processes  for  obtaining  validity  evidence 
(primarily  from  meta-analyses)  and  the  limitations  of  the  current  state  of  the  art.  Speculative 
future  prospects  are  briefly  reviewed. 

Robertson,  K.  D.,  &  Castle,  C.  (1996).  Complex  Visual  Task  (CVT):  Software  upgrade. 
Pensacola,  FL:  Naval  Aerospace  Medical  Research  Laboratory. 

Robins,  B.  S.  (2000).  American  eagles:  Forming  the  Lafayette  Escadrille,  RAF  Eagles  and 
Flying  Tigers.  Master  of  Arts,  University  of  Nebraska. 

Robinson,  L.,  Gainer,  C.,  &  Kahn,  O.  (1972).  Personnel  subsystem  test  and  evaluation  plan. 
Santa  Monica,  CA:  Lear  Siegler  Inc. 

Roff,  M.  (1953).  The  pilot  candidate  selection  research  program,  V:  A  factorial  study  of  the 

motor  aptitudes  area.  Lackland  Air  Force  Base,  TX:  U.S.  Air  Force  School  of  Aviation 
Medicine. 

Roff,  M.  F.  (1948).  Psychological  research  at  the  AAF  School  of  Aviation  Medicine.  Journal  of 
Aviation  Medicine,  19,  20-23. 

Roff,  M.  F.  (195 1).  Personnel  selection  and  classification  procedures:  Spatial  tests  (Project  No. 
21-29-112).  Randolph  Field,  TX:  USAF  School  of  Aviation  Medicine. 

Rogers,  D.  A.,  Covington,  E.  C.,  &  Jensen,  R.  S.  (1999).  Response  predispositions  and  piloting 
safety.  International  Journal  of  Aviation  Psychology,  9(1),  73-90. 


217 


Rogers,  D.  L.  (1983).  Development  of  the  Air  Force  officer  screening  composites.  Paper 

presented  at  the  25th  Annual  Military  Testing  Association  Conference,  Gulf  Shores,  AL. 

Rogers,  D.  L.  (1984).  The  effectiveness  of  biographical  inventories  in  predicting  success  in  OTS. 
Paper  presented  at  the  9th  Symposium  on  Psychology  in  the  Department  of  Defense,  U.S. 
Air  Force  Academy,  Colorado  Springs,  Co. 

Rogers,  D.  L.  (1985).  Screening  composites  for  Air  Force  officers.  Brooks  Air  Force  Base,  TX: 
Air  Force  Human  Resources  Laboratory. 

Rogers,  D.  L.,  Roach,  B.  W.,  &  Short,  L.  O.  (1986).  Mental  ability  testing  in  the  selection  of  Air 
Force  Officers:  A  brief  historical  overview.  Brooks  Air  Force  Base,  TX:  Air  Force 
Human  Resources  Laboratory. 

This  paper  addresses  the  use  of  officer  selection  and  classification  tests  from  the  early 
1940s  to  1986,  with  emphasis  on  the  evolution  of  the  Air  Force  Officer  Qualifying  Test 
(AFOQT).  It  is  intended  as  a  readable  historical  overview  of  officer  testing,  not  as  a  detailed 
technical  document.  The  paper  emphasizes  AFOQT  test  forms  and  content  as  they  relate  to  each 
other,  up  to  and  including  the  present  operational  version,  Form  0. 

Rogers,  D.  L.,  Roach,  B.  W.,  &  Wegner,  T.  G.  (1986).  Air  Force  Officer  Qualifying  Test  Form 
0:  Development  and  standardization.  Brooks  Air  Force  Base,  TX:  Air  Force  Human 
Resources  Laboratory. 

Rogers,  M.  S.,  &  Shure,  G.  H.  (1962).  Personality  factor  stability  for  three  ability  levels.  Santa 
Monica,  CA:  System  Development  Corp. 

Rogers,  O.  E.  (1956).  Analysis  of  basic  training  stage  grades  for  multi  engine  and  single-engine 
aviators.  Pensacola,  FL:  U.S.  Navy  School  of  Aviation  Medicine. 

Roscoe,  S.  N.  (1993).  An  aid  in  the  selection  process  -  WOMBAT.  Civil  Aviation  Training,  4(2), 
48-51. 

Roscoe,  S.  N.  (1997).  The  Adolescence  of  Engineering  Psychology.  Human  Factors  History 
Monograph  Series,  Volume  1,  1-9. 

This  retrospective  account  of  the  emergence  of  engineering  psychologists  -  in  the 
military,  in  academia,  in  the  aviation  industry,  in  troubleshooting  system  problems,  in  consulting, 
and  in  course  setting  for  civil  and  military  agencies  -  is  based  largely  on  my  recollections  and 
many  years  of  correspondence  with  others  of  similar  vintage  or  older. 

Roscoe,  S.  N.,  &  Corl,  L.  (1987).  Wondrous  original  method  for  basic  airmanship  testing.  Paper 
presented  at  the  4th  International  Symposium  on  Aviation  Psychology,  Columbus,  OH. 

Roscoe,  S.  N.,  Corl,  L.,  &  LaRoche,  J.  (1997).  Predicting  Human  Performance.  Pierrefonds  QC: 
Helio  Press,  Inc. 

Roscoe,  S.  N.,  &  Williams,  A.  C.  (1980).  Aviation  psychology  (1st  ed.).  Ames:  Iowa  State 


218 


University  Press. 

Roscoe,  S.  N.,  &  Williges,  B.  H.  (1971).  Three  lessons  in  aviation  research.  Urbana: 

Engineering  Publications  Office,  College  of  Engineering,  University  of  Illinois  at 
Urbana-Champaign. 

Rosenberg,  N.,  &  Izard,  C.E.  (1953).  Vocational  interests  of  Naval  aviation  cadets:  Preliminary 
findings.  Pensacola,  FL:  U.S.  Navy  School  of  Aviation  Medicine. 

Rosenberg,  N.  (1954).  Time  to  complete  naval  air  training  as  an  additional  criterion  of  success. 
Pensacola,  FL:  Naval  School  of  Aviation  Medicine. 

Rosenberg,  N.,  &  Izard,  C.  E.  (1954).  Vocational  interests  of  Naval  aviation  cadets.  Journal  of 
Applied  Psychology,  38,  354-358. 

Rosenberg,  N.,  Martinek,  H.,  &  Anderson,  A.  A.  (1959).  Development  of  a  provisional  battery 
for  selecting  Army  helicopter  pilot  trainees.  Washington,  DC:  The  Adjutant  General's 
Office. 

Rosenberg,  N.,  Skordahl,  D.  M.,  &  Anderson,  A.  A.  (1961).  Development  of  experimental 

selectors  for  Anny  helicopter  pilot  trainees:  Personality  constructs.  Washington,  DC:  The 
Adjutant  General's  Research  and  Development  Command. 

Rosenberg,  N.,  Skordahl,  D.  M.,  &  Kaplan,  H.  (1961).  Validation  of  Anny  Fixed  Wing  Aptitude 
Battery  against  success  in  ROTC  flight  training.  Washington,  DC:  The  Adjutant 
General's  Research  and  Development  Command. 

Rosenberg,  N.,  Skordahl,  D.  M.,  &  Kaplan,  H.  (1961).  Validation  of  Anny  Fixed-Wing  Aptitude 
Battery  against  success  in  Anny  flight  training.  Washington,  DC:  U.  S.  Army  Adjutant 
General’s  Research  and  Development  Command. 

The  Anny  Fixed-Wing  Aptitude  Battery  (AFWAB)  has  been  used  operationally  since 
1956  to  select  trainees  for  the  Anny  Fixed-Wing  Flight  Training  Program.  The  present  study  was 
undertaken  to  evaluate  the  battery  for  use  in  selecting  trainees  for  the  ROTC  Flight  Training 
Program.  Additional  purposes  were  to  provide  information  which  could  be  used  to  establish 
cutting  scores  appropriate  to  the  Army's  ROTC  flight  training  requirements  for  a  given  year  and 
to  study  the  effect  of  weighting  the  tests  by  a  multiple  correlation  procedure.  The  battery  was 
administered  to  samples  of  ROTC  Flight  Training  Program  applicants  representative  of  ROTC 
classes  of  academic  years  1956-57,  1957-58,  and  1958-59  (total  N  =  1245).  The  AFWAB  was 
found  to  have  useful  validity  against  a  criterion  of  successful  completion  of  the  Flight  Training 
Program  (r  =  .33).  All  component  tests  were  found  to  contribute  to  the  selective  efficiency  of  the 
battery  (correlation  coefficients  ranged  from  .20  to  .24,  intercorrelation  coefficients  from  .  1 1  to 
.52).  The  unit-weighted  composite  proved  to  be  as  effective  as  the  administratively  more 
cumbersome  optimally  weighted  score. 

Rossmeissl,  P.  G.,  &  Dohme,  J.  A.  (1982).  Using  rating  scales  to  determine  aptitude 

requirements  of  Army  systems.  Paper  presented  at  the  24th  Annual  Military  Testing 


219 


Association  Conference,  San  Antonio,  TX. 

Rotch,  A.  L.  (1900).  Sounding  the  Ocean  of  Air.  London:  Society  for  Promoting  Christian 
Knowledge. 

Rotch,  A.  L.  (1909).  The  Conquest  of  the  Air  or  the  Advent  of  Aerial  Navigation.  New  York: 
Moffat,  Yard  and  Company. 

Roth,  J.  T.  (1980).  Continuation  of  data  collection  on  causes  of  attrition  in  Initial  Entry  Rotary 
Wing  training,  (pp.  53).  Valencia,  PA:  Applied  Science  Associates,  Inc. 

Rumsey,  M.  G.,  Vicino,  F.,  &  Kyllonen,  P.  (1993).  Joint  Service  Plan  for  Selection  and 
Classification  Research:  1993  -  2003.  Paper  presented  at  the  35th  Annual  Military 
Testing  Association  Conference,  Williamsburg,  VA. 

Downsizing,  declining  military  budgets,  and  changing  world  conditions  have  combined 
to  create  a  growing  need  for  the  military  services  to  coordinate  their  research  efforts.  Responding 
to  this  need,  coordinate  manpower,  they  reached  an  agreement  in  1990  to  personnel  and  training 
research  through  a  committee  known  as  TAPSTEM.  Selection  and  classification  was  identified 
as  a  major  component  of  manpower  and  personnel  research,  and  a  Selection  and  Classification 
Subcommittee  was  established  to  assist  the  Manpower  and  Personnel  working  group  in 
addressing  this  area.  This  year,  the  subcommittee  was  charged  with  developing  a  long-range 
joint  service  selection  and  classification  research  plan.  This  paper  describes  this  plan. 

Rumsey,  M.  G.,  Walker,  C.  B.,  &  Harris,  J.  H.  (Eds.).  (1994).  Personnel  Selection  and 
Classification.  Hillsdale,  NJ:  Lawrence  Erlbaum  Associates. 

Samet,  M.  G.,  Geisehnan,  R.  E.,  Zajaczkowski,  F.,  &  Marshall-Miles,  J.  (1986).  Complex 

Cognitive  Assessment  Battery  (CCAB):  Test  descriptions.  Los  Angeles,  CA:  Analytical 
Assessments  Corp. 

Sanders,  J.  H.,  Valentine,  L.  D.,  &  McGrevy,  D.  F.  (1971).  The  development  of  equipment  for 
psychomotor  assessment.  Lackland  Air  Force  Base,  TX:  Air  Force  Human  Resources 
Laboratory. 

The  purpose  of  the  work  was  to  develop  a  highly  flexible  psychomotor  testing  system 
capable  of  reproducing  the  psychological  task  structure  of  two  electromechanical  tests  used 
earlier  in  Air  Force  pilot  selection  programs.  These  were  the  SAM  Complex  Coordination  Test 
and  the  SAM  Two-Hand  Coordination  Test.  The  work  was  conducted  in  two  phases,  the  first  of 
which  resulted  in  the  definition,  design,  assembly,  and  testing  of  the  psychomotor  testing  system. 
The  second  phase  involved  the  testing  of  120  Air  Force  pilot  candidates  and  analysis  of  the  data. 
The  system  developed  to  implement  these  tests  consists  of  two  test  stations  (expandable  to  eight) 
and  a  test  control  unit.  Test  control  station  functions  are  performed  with  a  PDP-8/L  digital 
computer  which  can  generate  graphical,  alphanumeric,  or  point  displays  on  a  direct-view  storage 
tube.  The  feasibility  of  this  psychomotor  testing  system  was  demonstrated  and  found  to  be  highly 
flexible  and  efficient,  with  a  capability  for  conducting  test  sessions  under  automated  conditions. 

Sanders,  M.  G.,  &  Hoffman,  M.  A.  (1975).  Personality  aspects  of  involvement  in  pilot-error 


220 


accidents.  Aviation,  Space,  and  Environmental  Medicine,  46(2),  186-190. 

The  authors  examined  the  utility  of  a  decision-making  task  and  various  personality 
variables  for  discriminating  between  pilots  who  had  been  involved  in  an  accident  and  those  who 
had  not.  Subjects  were  5 1  volunteer  military  aviators  with  ranks  ranging  from  Chief  Warrant 
Officer-2  to  Lieutenant  Colonel.  Prior  accident  involvement  was  determined  through  an 
investigation  of  the  United  States  Army  Agency  for  Aviation  Safety  (USAAAVS)  accident 
records.  Each  aviator  listed  as  a  causal  factor  in  at  least  one  aviation  accident  (either  major, 
minor,  or  incident)  was  classified  as  pilot-error  accident  involved  (PEAI),  otherwise,  they  were 
classified  as  pilot-error  accident  free  (PEAF).  Several  measures  were  administered  to  all  of  these 
aviators.  The  first  was  the  16  PF  (Form  A),  a  personality  inventory,  which  consists  of  16  primary 
factors  and  four  secondary  factors.  The  second  inventory  was  the  Mehrabian  Achievement  Scale 
which  provides  an  indication  of  need  for  achievement  or  desire  to  attain  success.  A  decision¬ 
making  task  was  also  administered  which  involved  having  the  subject  decide  when  to  leave  a 
light  on  or  turn  it  off,  based  on  a  set  of  rules.  Subjects'  scores  were  the  means  of  each  of  the 
various  instruments  taken  over  several  different  trials.  The  first  analysis  included  the  measures 
from  the  16  PF  and  the  N-Ach  score  from  the  Mehrabian.  Three  of  the  21  scores  discriminated 
between  the  PEM  and  the  PEAF  aviators:  (1)  Group  Dependent  vs.  Self  Sufficient;  (2)  Practical 
vs.  Imaginative;  and  (3)  Forthright  vs.  Shrewd.  These  three  scores  correctly  classify  86  percent 
of  the  sample  into  either  the  PEAT  or  the  PEAF  groups.  The  second  stepwise  discriminant 
analysis  included  the  scores  from  the  decision-making  task.  Again,  none  of  these  scores 
successfully  discriminated  between  the  two  groups  of  aviators.  This  study  was  cross-validated  in 
a  later  paper  (Sanders,  Hoffmann,  &  Neese,  1976)  and  the  results  did  not  replicate. 

Sanders,  M.  G.,  Hoffmann,  M.  A.,  &  Neese,  T.  A.  (1976).  A  Cross-validation  study  of  the 
personality  aspects  of  involvement  in  pilot-error  accidents.  Aviation,  Space,  and 
Environm ental  Medicine,  47(2),  177-179. 

The  authors  conducted  a  cross-validation  study  in  an  attempt  to  replicate  the  results 
obtained  by  Sanders  and  Hoffman  (1975).  The  sample  consisted  of  66  military  aviators.  Once 
again  the  16  PF  (Form  A)  was  administered.  Pilots  were  classified  into  one  of  two  groups,  either 
pilot-error  accident  involved  (PEAI)  or  pilot-error  accident  free  (PEAF)  based  on  United  States 
Anny  Agency  for  Aviation  Safety  (USAAAVS)  accident  records.  The  stepwise  discriminant 
analysis  did  not  discriminate  between  PEAI  and  PEAF  aviators.  A  second  stepwise  discriminant 
analysis  was  perfonned  using  age,  total  military  flight  hours  and  years  of  flight  status.  None  of 
these  variables  discriminated  between  PEAF  and  PEN  pilots.  The  authors  conclude  that 
individual  differences  in  personality  characteristics  of  aviators  prevented  the  identification  of 
personality  traits  associated  with  the  PEAI  and  the  PEAF  groups. 
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Unmanned/uninhabited  aerial  vehicles  (UAVs)  are  an  increasingly  important  part  of 
military  operations  throughout  the  world.  However  there  is  no  consensus  about  who  should  fly 
these  aircraft .  The  United  States  Air  Force  (USAF)  Corona  South  four-star  general  officer 
Summit  in  1997  resulted  in  tasking  the  Air  Force  Research  Laboratory  to  conduct  a  study  to 
compare  the  speed  and  accuracy  with  which  various  groups  of  pilots  could  leam  to  fly  the  RQ-1 
A  Predator  UAV.  This  study  primarily  addressed  stick-and-  rudder  skills  ;  we  did  not  measure 
such  operationally  relevant  factors  as  communication  skills,  command  experience,  or  knowledge 
of  combat  operations  .  Seven  groups  of  military  and  civilian  pilots,  varying  in  amount  and  kind 
of  flying  experience,  completed  a  series  of  multimedia  tutorials  on  principles  of  flight  and 
procedures  for  operating  the  Predator,  then  flew  a  high-fidelity  RQ-IA  simulator.  Each 
participant  flew  basic  maneuvers  and  landings  (including  difficult  crosswind  landings)  until  a 
very  high  standard  of  aircraft  control  performance  was  achieved,  then  flew  30  reconnaissance 
scenarios.  During  this  time,  detailed  measures  of  performance  were  continuously  and 
automatically  recorded  .  The  results  show  that,  though  Predator  pilots  perfonned  best  (and 
nonpilots  perfonned  worst),  USAF  T-38  graduates  and  civilian  pilots  with  single-engine 
instrument  training  performed  nearly  as  well  as  a  group  of  highly  experienced  military  pilots 
assigned  (but  not  yet  trained)  to  fly  Predator.  A  possible  explanation  for  the  relatively  good 
perfonnance  of  the  T-38  and  civilian  instrument  pilots  is  that  there  may  be  advantages  to  recent 
experience  flying  aircraft  that  have  handling  characteristics  that  are  similar  to  the  Predator. 
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An  analysis  was  perfonned  to  identify  specific  skills  required  to  successfully  perform 
operations  and  unit  maintenance  tasks  for  the  future  tactical  unmanned  vehicle  (TUV)  and  to 
detennine  if  U.S.  Army  soldiers  and  U.S.  marines  with  a  skill  level  of  10  have  those  skills.  This 
analysis  was  performed  by  the  Human  Research  and  Engineering  Directorate  of  the  U.S.  Anny 
Research  Laboratory  at  the  behest  of  the  Program  Manager  Unmanned  Ground 
Vehicles/Systems.  Military  occupational  specialties  examined  included  U.S.  Anny  infantryman 
(1IB),  cavalry  scout  (19D),  and  the  Marine  Corps  rifleman  (0300).  System-required  operations 
and  unit  maintenance  functions  and  tasks  were  identified.  Soldier-marine  operations  and  unit 
maintenance  skills  were  compared  to  these  tasks.  Results  of  the  analysis  show  that  of  209 
operations  skills  required  by  the  TUV  system,  82  were  mismatched  because  of  a  higher  skills 
requirement,  untrained  system-specific  skills,  or  a  combination  of  both.  Additionally,  all  25  unit 
maintenance  tasks  were  identified  as  requiring  system-specific  training. 
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It  has  long  been  the  belief  of  the  writer  of  these  notes  that  the  functions  of  certain 
branches  of  the  service  auxiliary  to  the  line  in  the  United  States  army  are  not  in  general  well 
understood  even  by  people  who  are  interested  in  military  affairs.  The  reasons  for  this  are,  no 
doubt,  in  part  due  to  the  fact  that  the  functions  of  these  auxiliaries  are  many  and  varied,  and  are 
not  outlined  in  available  fonn  or  even  clearly  defined  except  in  the  brief  and  general  statements 
of  laws,  regulations,  or  orders  affecting  the  service.  This  lack  of  knowledge  seems  to  be 
especially  true  of  the  corps  with  which  the  writer  has  long  had  the  honor  to  serve,  the  name  of 
which  gives  no  indication  what-ever  of  its  functions,  scope,  and  value  to  the  army.  It  is  thought, 
therefore,  that  an  outline  of  the  duties  and  field  of  usefulness  of  the  signal  corps  of  the  army  may 
be  of  value  to  those  interested  in  military  affairs,  to  others  upon  whom  the  anny  must  depend  for 
its  maintenance,  and  to  officers  and  men  of  the  national  guard  who  will  be  called  upon  to 
perform  the  duties  of  signalmen.  To  instructors  and  students  at  military  schools,  to  officers  of  the 
regular  anny  who  may  be  called  by  detail  or  by  accident  of  service  to  construct  and  maintain 
lines  of  information,  and  to  the  great  mass  of  the  volunteers  if  called  to  the  defense  of  the 
country,  these  notes  may  also  be  of  interest  and  use.  For  these  reasons  they  have  been  prepared. 
The  writer  begs  to  acknowledge  his  indebtedness  to  Lieut.  Col.  Samuel  Reber,  Maj.  Edgar 
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The  Anny  Research  Institute  (ARI)  was  directed  by  the  Deputy  Chief  of  Staff  for 
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Personnel  to  develop  and  validate  motivational  measures  to  aid  in  selection  of  enlisted  personnel. 
The  development  of  the  Military  Aptitude  Predictor  (MAP)  was  begun  in  1973  for  this  purpose. 
The  initial  MAP  included  the  trainee's  age,  education,  aptitudes,  and  civil  court  convictions 
(moral  waiver)  as  predictors  of  military  performance,  and  was  intended  for  use  at  the  Anned 
Forces  Examining  and  Entrance  Stations  (AFEES).  The  1975  version  (MAP-75)  was  intended 
for  use  by  recruiters  to  provide  a  prediction  of  Basic  Combat  Training  (  BCT)  behavior  and 
perfonnance  at  an  earlier  point  in  time,  thus  saving  the  Anny  AFEES  transportation  and 
processing  costs.  In  April  1975,  the  Secretary  of  the  Army  directed  implementation  of  the  MAP 
to  begin  1  August  1975.  This  initial  testing  was  conducted  in  one  District  Recruiting  Command  ( 
DRC)  in  each  of  the  five  Recruiting  Regions  during  the  period  1  August  -  30  September  1975.  Its 
operational  use  was  suspended  on  1  October  1975  and,  immediately  following  suspension  of 
testing,  ARI  conducted  interviews  in  the  five  DRC's  to  determine  the  nature  and  extent  of 
problems  associated  with  its  use. 
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astronaut  applicants.  Aviation,  Space,  and  Environmental  Medicine,  65(10  Pt  1),  920-924. 
In  1991,  a  new  psychological  selection  procedure  was  employed  during  the  selection  of 
Japanese  Space  Station  astronauts.  It  was  based  on  international  selection  criteria  developed  by 
an  international  psychological/psychiatric  working  group.  A  total  of  372  individuals— fewer  than 
expected— submitted  applications  for  Space  Station  astronaut  in  Japan.  Of  the  applicants,  233 
were  given  several  psychological  written  tests  [Anxiety  Scale,  Perfonnance  Test,  General 
Aptitude  Test  Battery,  and  Environmental  Adjustment  Test  Battery  (EATB)]  in  Phase  I  of  the 
selection.  Forty-five  applicants  went  on  to  take  the  General  Aptitude  Test  Battery  (GATB), 
Human  Assessment  Method  (a  group  test),  a  semi-structured  psychological  interview  and  an 
intelligence  test  in  Phase  II  of  the  selection.  All  applicants  were  found  to  be  highly  intelligent. 
Interestingly,  an  unexpectedly  large  number  of  candidates  were  disqualified  by  the  newly 
developed  EATB.  Assessment  of  individual  functioning  in  a  group  (the  Human  Assessment 
Method)  resulted  in  no  applicant  being  ranked  in  either  the  "qualified  with  reservation"  (QR)  or 
"disqualified"  (DQ)  category.  Much  has  been  learned  from  this  initial  application  of 
psychological  "select-in"  testing,  but  further  efforts  are  needed  to  improve  both  psychological 
criteria  and  evaluation  methods  and  to  determine  their  reliability  and  validity. 
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This  was  the  third  progress  report  on  the  development  of  a  personality  battery  to 
supplement  present  aircrew  selection  techniques.  The  goal  of  the  program  was  to  identify 
prospective  aircrew  trainees  who  were  predisposed  to  difficulties  in  adapting  to  the  rigors  of 
military  flying.  Predictor  measures  included  a  wide  variety  of  aptitude,  personality,  perceptual, 
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attitude  and  psychomotor  variables.  Personnel  infonnation  from  Personnel  File  Form  66  and  the 
20  1  File  concerning  rate  and  extent  of  promotion,  type  of  assignment,  extent  of  command 
responsibility  and  flying  duties  involved  were  gathered  to  use  as  criteria.  Psychologists  made 
adjustment  ratings,  one  of  which  was  a  purified  pass/fail  criterion.  The  high  group  included  those 
who  graduated  from  training  and  were  well-adjusted.  The  low  group  consisted  of  pilots  who 
failed  training  for  reasons  of  poor  motivation,  excessive  emotional  reaction,  or  overt  symptoms 
attributable  to  stress  in  the  program.  The  following  are  the  results  obtained  when  correlating  the 
different  predictors  with  the  various  criteria.  The  Aviation  Interest  Key  is  comprised  of  25  items 
covering  the  attitudes  of  parents  toward  the  trainees  participation  in  hazardous  sports,  a  history 
of  motion  sickness,  prior  military  flying  experience,  etc.  It  yielded  correlations  of  .37  to  .41  with 
the  purified  pass/fail  criterion  controlling  for  pilot  stanine.  Seven  Minnesota  Multiphasic 
Personality  Inventory  (MMPI)  scales  (Hs,  Pd,  Winne,  Taylor,  Seaquist,  D  and  Hy)  correlated 
from  .  10  to  .40  (mean  =  .24)  with  the  purified  pass/fail  criterion  measure.  The  Pilot  Opinionaire 
used  an  indirect  polling  approach  to  assess  attitudes  toward  various  aspects  of  military  aviation 
(and  also  included  an  authoritarianism  scale).  Correlations  were  found  between  it  and  the 
pass/fail  criterion  that  ranged  from  .28  for  cadets  to  .11  for  officers.  The  author  also  demonstrated 
that  even  though  aptitude  measures  were  much  more  highly  correlated  with  the  pass/fail  criterion 
(r  =  .53),  they  correlated  only  .13  with  infonnation  from  Form  66  (which  involves  job 
performance).  Whereas,  the  correlations  of  the  personality  variables  remained  relatively 
constant,  albeit  low  (r  =  -1  1).  At  this  point  in  time,  only  four  screening  tests  have  been  validated 
against  post-training  criteria,  the  Personal  Inventory  (PI),  the  Cornell  Index  (Cl),  the  Cornell 
Word  Fonn  (CWF)  and  the  Sentence  Completion  (SC)  Factor  scores.  The  correlations  of  these 
tests  with  various  personnel  file  form  (Fonn  66)  infonnation  ranged  from  -.07  (for  Interpersonal 
Attitudes)  to  .23  (for  Self-Enhancement). 

Sells,  S.  B.  (1955).  Development  of  a  personality  test  battery  for  psychiatric  screening  of  flying 

personnel.  Aviation  Medicine,  25,  35-45. 

The  author  characterizes  the  qualifications  for  jobs  in  combat  aircrews  as  encompassing 
three  areas:  (1)  physical  qualifications;  (2)  abilities  and  aptitudes;  and  (3)  personality  factors.  He 
notes  that  the  USAF  has  developed  thorough  and  effective  standards  for  selection  procedures  for 
the  first  two  areas,  but  not  for  the  third  area.  This  report  summarized  the  progress  to  date  on  a 
large  scale  developmental  project  (started  in  1949)  to  update  the  USAFs  use  of  personality 
factors  in  selection.  The  present  research  included  only  pilots.  Subjects  were  administered  a  wide 
range  of  paper  and  pencil,  projective,  performance  and  apparatus  tests.  Students  entering  flying 
school  were  not  told  that  they  could  be  eliminated  based  on  the  results  of  the  test,  but  they  were 
led  to  believe  that  the  tests  would  be  used  for  administrative  decisions  (i.e.,  selection).  Validation 
of  the  tests  were  in  progress  (or  planned)  at  the  time  of  this  article  was  written  for  three  stages  in 
the  students  careers:  (1)  training;  (2)  post-training  and  operational  experience;  and  (3)  combat 
perfonnance  (based  on  data  collected  in  Korea).  The  results  indicated  that  ratings  made  by 
classmates  and  by  instructors  during  training  were  superior  to  psychologists'  evaluations  in 
predicting  combat  perfonnance.  However,  a  significant  positive  conelation  was  found  between 
perfonnance  ratings  in  combat  and  an  absence  of  pathological  behavior  symptoms  in  the  clinical 
reports  made  by  a  field  survey  team.  Also,  pilots  with  superior  adjustment  ratings  in  training  and 
higher  pilot  stanines  tended  to  have  more  accidents.  At  the  time  this  article  was  written,  all 
studies  had  been  conducted  using  training  level  criteria,  which  relies  on  a  pass/fail  criterion.  The 
author  advocates  using  "purified"  pass/fail  measures.  For  example,  one  approach  is  to  classify 
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the  population  into  more  refined  administrative  categories  according  to  their  performance  in 
training.  Finally,  the  author  stated  that  there  are  three  broad,  interrelated  areas  in  which  efforts 
should  be  concentrated:  (1)  specific  motivational  structure;  (2)  character  integration;  and  (3) 
tolerance  of  frustration  and  anxiety. 
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A  field  tryout  of  an  experimental  test  battery  for  adaptability  screening  of  flying 
personnel  was  begun  in  September,  1956,  by  the  U.S.  Air  Force  School  of  Aviation  Medicine  at 
Lackland  Air  Force  Base,  Texas.  This  battery  consisted  of  seven  paper  and  pencil,  machine 
scored,  personality  and  motivational  tests  which  had  been  developed  and  validated  in  previous 
research.  1-6. 10  These  tests  have  been  ad  ministered,  under  operational  testing  conditions  to 
9,500  students  entering  pre-flight  schools  for  aircrew  training  as  part  of  their  entrance  physical- 
examination.  The  Field  Testing  Laboratory  of  the  Department  of  Medical  Psychology  of  this 
school,  carried  out  this  project,  under  the,  direction  of  one  of  us  (R.C,T.). 

Senders,  J.  W.  (2007).  Response:  Is  the  "Is  the  UAV  control  ration  the  right  question?"  the  right 
answer?  Ergonomics  in  Design,  75,  31. 

There  are  a  variety  of  ongoing  attempts  to  generate  unmanned  aerial  vehicle  (UAV) 
technologies  to  exploit  the  advantages  that  these  semiautomated  and  automated  airborne 
platforms  promise  to  render.  (Although  we  refer  specifically  to  UAVs  here,  our  arguments  apply, 
in  principle,  to  all  remote  vehicles  whatever  their  medium  of  operation.  The  principles 
themselves  also  extend  to  other  forms  of  nontransport-based  entities.)  With  regard  to  such 
operations,  the  collective  community  is  searching  for  the  ratio  between  operator(s)  and  vehicle(s) 
that  will  prove  most  efficient  and  effective. 

Serusi,  C.,  &  Calanna,  P.  (2004).  Validity  of  a  Computer-Based  Test  System  and  Psychological 
Assessment  in  Controlling  Flight  Training  False  Positive  Rate.  Paper  presented  at  the 
46th  Annual  International  Military  Testing  Association  Conference,  Brussels,  Belgium. 
The  reduction  of  military  pilot  training  attrition  rates  is  a  central  issue  for  any  successful 
and  cost-effective  selection  procedure.  With  this  object  in  mind,  a  validation  study  was  designed 
using  the  -Pilot  Aptitude  Tester”  (PILAPT)  together  with  other  assessments  used  by  the  Italian 
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Air  Force  (IAF).  The  main  hypothesis  was  that  the  combined  use  of  traditional  and  computer- 
based  techniques  would  reduce  false  positive  rates  in  selecting  candidates  admitted  to  flight 
training. 
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involved  and  communications  were  analysed  for  content,  agencies  involved,  and  relevance  to  the 
crew's  task.  The  results  of  this  study  indicate  that  data  gathered  from  a  controlled  test 
environment  can  differ  considerably  from  those  obtained  in  operational  settings  and  that 
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awareness  and  to  detennine  whether  current  situation  awareness  measurement  techniques  are 
adequate  to  be  used  as  a  part  of  personnel  selection  tests.  In  order  to  determine  if  this  is  the  case, 
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presented  at  the  33rd  Annual  Meeting  of  the  Human  Factors  Society. 

In  this  paper,  the  relationships  between  a  Risk  Test,  the  Pilot  Personality  Questionnaire 
(PPQ),and  a  pass/fail  training  criterion  and  academic  grades  were  examined.  The  authors  also 
examined  the  relationships  between  the  two  predictor  measures  and  the  current  U.S. 

Navy/Marine  Corps  aviation  selection  battery,  the  Academic  Qualifications  Test  flight  Aptitude 
Rating  (AQT1FAR).  Subjects  were  407  student  naval  aviators  (SNAs)  and  182  student  naval 
flight  officers  (SNFOs)  who  took  the  Risk  Test  and  1 10  SNAs  and  1  14  SNFOs  who  took  the 
PPQ.  In  the  Risk  Test,  subjects  are  asked  to  choose  which  of  ten  squares  is  the  reward  square 
accumulating  points  as  they  go.  The  average  number  of  responses  (NR)  and  the  corresponding 
average  reaction  time  (RT)  are  measured  for  each  trial.  The  PPQ  is  a  self-administered 
personality  inventory  containing  112  multiple-choice  items,  which  is  a  combination  of  4 
different  personality  tests:  Locus  of  Control,  Work  and  Family  Orientation,  Personality 
Attributes  Questionnaire  and  a  Social  Desirability  Scale.  The  AQT  is  a  general  cognitive  ability 
measure  and  the  FAR  is  comprised  of  the  Mechanical  Comprehension  Test,  the  Spatial 
Apperception  Test  and  the  Biographical  Inventory.  Results  showed  that  for  the  SNAs,  the 
number  of  responses  on  the  Risk  Test  correlated  .13  @  <  -05)  with  Undergraduate  Pilot  Training 
(UPT)  pass/fail  criterion  and  -.  13  (p  <  .05)  with  academic  grades.  Reaction  time  correlated  -.18 
(p  <  -05)  with  UPT  pass/fail.  For  the  PPQ,  the  Social  Desirability  Scale  correlated  -.30  (p  <  .05) 
with  UPT  pass/fail  and  -.45  (p  <.05)  with  academic  grades.  For  the  SNFOs,  the  number  of 
responses  on  the  gambling  risk  test  correlated  .28  (p  <  .05)  with  UPT  pass/fail,  while  reaction 
time  correlated  -.45  (p  <  .05)  with  UPT  pass/fail.  Neither  the  number  of  responses  nor  the 
reaction  time  variables  from  the  Risk  Test  were  correlated  with  academic  grades.  For  the  PPQ, 
high  self  control  correlated  .40  @  <  -05)  with  UPT  pass/fail,  but  no  other  scales  were  correlated 
with  this  criterion.  For  the  academic  grades  criterion,  PPQ  aggressiveness  correlated  .54  (p  < 

.05),  high  competitiveness  correlated  -52  (y  <  .05)  and  submissiveness  correlated  -.55  @  <  .05). 
The  authors  concluded  that  those  trainees  who  exhibited  more  risk-taking  behavior  were  more 
likely  to  complete  flight  training.  However,  the  experienced  pilots  showed  less  risk-taking 
behavior  than  the  SNAs.  This  may  mean  that  although  in  training  those  that  are  successful  are 
more  likely  to  take  risks,  once  they  become  pilots  they  demonstrate  more  cautious  behavior  (i.e., 
take  more  calculated  risks  where  they  can  assess  the  likelihood  of  failing). 

Shull,  R.  N.,  Dolgin,  D.  L.,  &  Gibb,  G.  D.  (1988).  The  Relationship  between  Flight  Training 

Perfonnance,  a  Risk  Assessment  Test,  and  the  Jenkins  Activity  Survey:  Naval  Aerospace 

Medical  Research  Laboratory. 

Current  aircrew  selection  research  at  the  Naval  Aerospace  Medical  Research  Laboratory 
has  focused  primarily  on  psychomotor  and  cognitive  abilities.  Evidence  from  studies  on  flight 
training  attrition  suggests  that  a  number  of  failures  may  be  attributed  to  personality  or 
motivational  factors  rather  than  a  lack  of  abilities.  Because  flight  training  success  is  a  dynamic 
interaction  of  abilities,  motivation,  and  personality  factors,  all  three  areas  should  be  included  to 
optimize  the  predictive  validity  of  aircrew  selection  batteries.  Two  sets  of  data  are  presented;  one 
set  is  from  a  computer  based  risk  assessment  task,  and  the  other  is  from  the  Jenkins  Activity 
Survey.  The  data  indicated  few  relationships  between  risk  assessment  measures  and  flight 
training  criteria.  We  found  only  one  indication  that  increased  risk  taking  was  associated  with 
successfully  completing  primary  flight  training.  The  Jenkins  Activity  Survey  results  indicated 
contradictory  relationships  between  the  scale  measures  and  flight  training  criteria  in  the  few 
significant  findings  observed. 
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Shull,  R.  N.,  &  Griffin,  G.  R.  (1990).  Perfonnance  of  Several  Different  Naval  Aviator 

Communities  on  a  Cognitive/Psychomotor  Test  Battery:  Pipeline  Comparison  and 
Prediction.  Pensacola,  FL:  Naval  Aerospace  Medical  Research  Laboratory. 

Research  is  currently  being  conducted  to  develop  reliable  predictor  tests  which  might  aid 
in  the  making  of  decisions  concerning  aircrew  assignment.  The  current  approach  involves 
comparing  the  perfonnance  of  several  different  aviator  communities  on  a  test  battery  measuring 
various  aspects  of  cognitive  and  psychomotor  functioning.  Four  groups  of  pilots  (two 
experienced  jet  groups,  one  experienced  helicopter  (helo)  group,  and  one  untrained  student 
group)  were  tested  on  this  battery.  Overall,  the  jet  groups  performed  in  an  equivalent  manner, 
while  the  helo  group  showed  a  lower  test  perfonnance  level  in  comparison.  The  student  group 
perfonned  at  a  lower  level  than  the  experienced  groups  in  general.  Within  this  student  group, 
pilot  trainees  who  were  assigned  to  the  jet  pipeline  did  significantly  better  on  several  of  these 
tests  than  those  trainees  who  were  assigned  to  either  helicopter  or  land-based  fixed-wing 
pipelines.  Many  of  the  test  perfonnance  differences  seen  between  these  jet  and  helo  student 
pipeline  groups  were  also  seen  between  the  experienced  jet  and  helo  pilots  tested.  Shull,  R.  N. 
and  G.  R.  Griffin  (1990).  Predicting  F-14  air  combat  maneuvering  (ACM)  perfonnance  using  an 
automated  battery  of  cognitive/psychomotor  tests.  Naval  Air  Station  Pensacola,  FL,  Naval 
Aerospace  Medical  Research  Laboratory.  Some  studies  have  suggested  the  possibility  of 
predicting  operational  performance  in  fleet  aviation  environments.  The  cunent  report  concerns 
the  use  of  an  automated  perfonnance-based  test  battery,  involving  cognitive  and  psychomotor 
functioning,  to  predict  the  operational  performance  of  fighter  pilots.  A  group  of  jet  pilots 
completing  Air  Combat  Maneuvering  (ACH)  training  in  the  F-14  were  tested  on  this  battery.  The 
few  significant  correlations  found  between  the  test  measures  and  ACM  perfonnance  measures 
were  illogically  patterned  and  of  insufficient  quantity  or  strength  to  establish  that  such  a  battery 
would  reliably  predict  ACM  perfonnance.  This  could  have  been  due  to  the  homogeneous  nature 
of  the  subject  group  in  terms  of  pilot  skills  and  abilities.  Given  these  results,  this  particular  test 
battery  would  probably  not  be  useful  in  the  prediction  of  flight  performance  at  such  a  late  stage 
of  training  as  ACM,  but  it  might  predict  flight  perfonnance  in  earlier  training. 
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presented  at  the  32nd  Annual  Meeting  of  the  Human  Factors  Society,  Anaheim,  CA. 

A  personality  inventory  was  given  to  509  USAF  pilot  candidates.  The  items  were 
combined  into  five  measures,  two  of  which  differentiated  training  successes  from  failures; 
graduates  demonstrated  higher  self-confidence  and  less  dogmatism.  As  an  alternative  approach 
to  examining  simple  relationships  between  personality  characteristics  and  training  outcomes 
personality  profiles  were  examined  as  predictors  of  perfonnance  criteria.  The  value  of  this 
approach  was  demonstrated  by  better  discrimination  of  training  graduates  from  non-graduates. 
The  implication  of  these  results  are  discussed,  as  are  plans  for  other  research  projects  designed  to 
replicate  and  extend  the  findings  from  the  current  study. 

Siem,  F.  M.  ( 1 989).  Personality  characteristics  of  USAF  pilot  candidates.  Paper  presented  at  the 
Human  Behavior  in  High  Stress  Situations  Involving  Aerospace  Operations  Conference. 

Siem,  F.  M.  (1990).  Development  of  a  selection  model  for  fighter-qualified  USAF  pilot 
candidates.  Paper  presented  at  the  American  Psychological  Association  Annual 
Convention,  Boston,  MA. 

The  authors  state  that  until  recently,  USAF  pilots  had  been  assigned  to  either  fighter 
aircraft  or  tanker-transport  aircraft  based  upon  the  recommendation  of  the  advanced  training 
recommendation  board  (ATRB).  The  purpose  of  this  study  was  to  develop  a  model  to  predict 
which  USAF  pilot  candidates  would  be  considered  by  the  ATRB  to  be  suitable  for  assignment  to 
fighter  aircraft  using  scores  from  the  Air  Force  Officer  Qualifying  Test  (AFOQT),  the  Basic 
Attributes  Tests  (BAT),  college  GPA  and  an  index  of  candidates'  preference  for  tanker-transport 
aircraft.  A  sample  of  426  Officer  Training  School  candidates  were  randomly  assigned  to  one  of 
two  subsamples.  For  each  subsample,  multiple  correlations  were  computed  between  the  42 
variables  and  the  ATRB  recommendation  outcome.  These  regression  models  were  then  each 
cross-validated  in  the  other  subsample.  The  full  models  for  sample  A  and  sample  B  were  both 
significant  (R  =  .61,  p  <  .001;  R  =  SO,  p  <  .05,  respectively).  For  each  subsample,  multiple 
regression  was  used  to  eliminate  variables  that  did  not  contribute  significantly  to  the  prediction 
of  ATRB  outcome.  For  sample  A,  the  final  reduced  model  contained  two  predictors:  AFOQT 
Instrument  Comprehension  and  Response  Time  (RT)  from  the  BAT  Mental  Rotation  task  (R  =  .3 
1,  p  <  .01).  For  sample  B,  the  reduced  model  contained  seven  predictors:  AFOQT  Instrument 
Comprehension  and  Block  Counting;  the  BAT  percent  correct  and  RT  variability  from  the 
Mental  Rotation  test  and  average  tracking  difficulty  from  the  Time  Sharing  test;  college  GPA; 
and  the  desire  to  fly  tanker-transport  rating.  For  the  cross-validity  results,  the  model  developed 
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for  sample  A,  had  a  multiple  correlation  of  -22  with  ATRB  recommendation  outcome  in 
subsample  B.  The  model  developed  in  sample  B,  had  a  multiple  correlation  of  .26  with  ATRB 
recommendation  outcome  in  sample  A.  Based  on  these  results  a  final  model  was  developed  that 
produced  a  multiple  correlation  of  .40  @  <  .001). 
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To  examine  the  utility  of  personality  testing  for  enhancing  current  Air  Force  pilot 
selection  procedures,  a  sample  of  509  USAF  officers  was  given  a  computer-administered 
personality  inventory,  the  Automated  Aircrew  Personality  Profiler  (AAPP)  prior  to  entry  into 
Undergraduate  Pilot  Training  (UPT).  Factor  analysis  of  16  scale  scores  indicated  that  the 
inventory  comprised  measures  of  five  personality  characteristics,  of  which  three  were  directly 
associated  with  UPT  training  outcome  (pass  or  fail):  Self-confidence,  Values  Flexibility,  and 
Hostility.  UPT  graduates  scored  higher  on  both  positive  dimensions  and  lower  on  hostility  than 
did  those  individuals  eliminated  for  flying  training  deficiency.  The  AAPP  failed  to  add  predictive 
utility  to  a  selection  model  that  combined  test  scores  from  the  Air  Force  Officer  Qualifying  Test 
(AFOQT)  and  the  Basic  Attributes  Tests  (BAT)  battery. 
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Hostility.  UPT  graduates  scored  higher  on  both  positive  dimensions  and  lower  on  hostility  than 
did  those  individuals  eliminated  for  flying  training  deficiency.  The  AAPP  failed  to  add  predictive 
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In  this  paper,  past  research  (e.g.,  Holden  &  Fekken,  1987)  is  discussed  showing  that 
individuals  who  scored  high  on  a  personality  trait  manifested  shorter  response  latencies  than 
individuals  who  scored  low  on  that  trait  on  items  that  were  "endorsed."  The  opposite  was  found 
for  items  that  were  "rejected."  Some  interpret  these  results  in  terms  of  a  "self-schema,"  which  is 
an  integrated  network  of  self  knowledge.  Five  hundred  and  nine  Air  Force  student  pilots  entering 
Undergraduate  Pilot  Training  (UPT;  332  for  which  training  outcome  was  available)  participated 
in  this  study.  The  Automated  Aircrew  Personality  Profiler  (AAPP)  was  administered  and 
includes  94  items  from  the  Minnesota  Multiphasic  Personality  Inventory  (MMPI).  Scores  were 
computed  on  the  following  scales:  Sociability  (Psychoticism),  Emotional  Stability  (Neuroticism), 
Extraversion,  Competency  (Inadequacy)  and  Cynicism.  The  criterion  used  was  UPT  training 
outcome  (pass/fail).  Response  latencies  were  standardized  within  subjects  to  control  for  reading 
speed  and  by  item  to  control  for  item  length  and  vocabulary  level.  For  each  subject  and  each 
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scale,  a  mean  response  time  for  endorsed  items  and  one  for  rejected  items  was  computed. 
Correlations  between  personality  scores  and  UPT  outcome  were  fairly  weak.  The  only 
significant  correlations  with  UPT  were  for  Sociability  (r  =  .  13,  p  <  .01)  and  Cynicism  (r  =  -.  14, 
p  <  .01).  Correlations  between  response  time  scores  with  the  criterion  were  only  significant  for 
endorsed  items  and  then  only  for  Extraversion  and  Cynicism.  The  author  noted  that  the  internal 
consistency  for  the  sociability  scale  was  only  .34.  Correlations  between  scale  and  response  time 
variables  for  each  trait  were  relatively  small  (ranging  from  .02  to  .35).  Correlations  between  the 
two  response  time  measures  (i.e.,  endorsed  and  rejected)  for  each  trait  were  also  small  (ranging 
from  -.01  to  .-.26). 

Siem,  F.  M.  (1992).  Incremental  validity  of personality  measures  for  predicting  pilot  training 

performance.  Paper  presented  at  the  American  Psychological  Association  Annual 

Convention,  Washington,  DC. 

Past  research  (e.g.,  Siem,  199  1)  has  indicated  that  personality  measures  based  on 
inventory  response  latencies,  as  well  as  scale  scores,  have  validity  for  predicting  pilot  training 
perfonnance.  The  purpose  of  this  study  was  to  examine  the  incremental  validities  of  these 
measures  in  predicting  training  performance.  Specifically,  two  issues  were  addressed:  (1)  the 
factor  structure  of  the  scale  scores  and  response  latency  scores  were  examined,  with  the 
expectation  that  the  measures  of  the  same  trait  would  load  on  the  same  factor;  and  (2)  the  extent 
to  which  these  personality  measures  would  contribute  unique  variance  to  the  prediction  of 
training  outcome  was  examined.  Three  hundred  thirty- two  college  graduates  who  had  been 
selected  for  Air  Force  pilot  training  were  included  in  the  factor  analyses,  277  of  these  students 
were  subsequently  included  in  the  multiple  regression  analyses.  Scores  from  three  predictors 
were  used  in  this  study:  (1)  the  Basic  Attributes  Tests  (BAT)  -  accuracy  and  response  time  scores 
were  collected  for  the  tests  and  psychomotor  tasks;  (2)  the  Automated  Aircrew  Personality 
Profiler  (AAPP)  -  data  on  item  endorsement  and  response  time  were  collected  for  each  item;  and 
(3)  the  Air  Force  Officer  Qualifying  Tests  (AFOQT).  Undergraduate  Pilot  Training  (UPT)  was 
dichotomously  scored  pass/fail.  Results  of  the  factor  analysis  related  to  the  first  hypothesis 
showed  that  one  factor  was  defined  by  the  scale  scores  for  the  Emotional  Stability,  Sociability 
and  Cynicism  dimensions.  Two  factors  were  defined  by  loadings  both  of  a  scale  score  and  a 
latency  score  (Extraversion  &  Cynicism).  The  remaining  two  factors  were  defined  by  loadings  of 
latency  variables  only  for  Cynicism  and  Emotional  Stability.  Results  related  to  hypothesis  2 
showed  that  the  full  model  correlated  .36  (p  <  .01)  with  UPT  pass/fail,  the  model  with  the  five 
AAPP  variables  removed  resulted  in  a  R-change  of  .06  @  <  .05).  Thus,  the  personality  variables 
did  add  to  the  prediction  of  UPT  outcome  beyond  the  AFOQT  and  the  BAT.  However,  further 
analyses  showed  that  all  but  one  of  the  five  AAPP  variables,  namely,  Extraversion,  could  be 
removed  from  the  model  without  a  decrease  in  validity. 
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Assesses  the  predictive  utility  contribution  of  personality  measures  on  the  pilot  selection 
procedure  of  the  U.S.  Air  Force.  Demonstration  of  a  direct  relation  between  hostility,  self- 
confidence  and  values  flexibility  to  training  outcome;  Negative  enhancement  of  the  predictive 
validity  of  the  selection  system;  Correlation  between  personality  and  aviation  perfonnance. 
Assesses  the  predictive  utility  contribution  of  personality  measures  on  the  pilot  selection 
procedure  of  the  U.S.  Air  Force.  Demonstration  of  a  direct  relation  between  hostility,  self- 
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confidence  and  values  flexibility  to  training  outcome;  Negative  enhancement  of  the  predictive 
validity  of  the  selection  system;  Correlation  between  personality  and  aviation  performance. 

Siem,  F.  M.  (1995).  Future  directions  for  pilot  personality  research.  Paper  presented  at  the 
Aerospace  Medical  Association  Meeting. 
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Military  Psychology,  5(1),  15-27. 
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pilots.  Brooks  AFB,  TX:  Annstrong  Laboratory. 

Siem,  F.  M.,  &  Carretta,  T.  R.  (1986).  The  development  and  initial  validation  of  the  basic 
attributes  tests  system. 

Siem,  F.  M.,  Carretta,  T.  R.,  &  Mercatante,  T.  A.  (1988).  Personality,  Attitudes,  and  Pilot 
Training  Perfonnance:  Preliminary  Analysis.  Brooks  AFB,  TX:  Air  Force  Human 
Resources  Laboratory. 

Developments  in  research  concerning  personality  characteristics  have  led  to  a  renewed 
interest  in  applications  of  individual  differences  measures  for  selection  of  pilot  candidates. 

Recent  research  efforts  have  focused  on  selecting  for  positive  characteristics,  rather  than 
screening  out  pathological  traits.  Another  development  is  the  use  of  tests  in  which  the  dimension 
of  interest  is  not  readily  apparent  to  the  examinee.  In  the  present  study,  five  personality  and 
attitude  measures  were  administered  to  883  USAF  pilot  candidates  as  part  of  an  experimental  test 
battery  under  consideration  for  operational  use  in  pilot  selection  and  classification.  These  tests 
were  designed  to  assess  decisiveness,  risk-taking,  self-confidence,  survival  attitudes,  and  field 
dependence/independence.  Scores  from  these  tests  wert  examined  for  their  utility  in  predicting 
training  outcome  (graduation  or  elimination)  and  advanced  training  recommendation  (fighter  or 
non-fighter  aircraft).  Results  indicated  that  as  a  group,  the  tests  demonstrated  weak  relationships 
with  the  perfonnance  criteria.  No  test  manifested  a  consistent  pattern  of  validity  for  both 
perfonnance  measures.  Only  the  test  of  self-confidence  appeared  to  contribute  to  predicting 
completion  of  training.  Future  research  efforts  are  discussed  with  regard  to  refining  the  current 
test  of  self-confidence  and  establishing  its  construct  validity. 
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selection  and  classification  research.  Paper  presented  at  the  30th  Annual  Military  Testing 
Association  Conference,  Arlington,  VA. 

Employment  interviews  are  widely  used  In  industry  and  the  military  for  personnel 
selection  and  classification,  although  the  scientific  evidence  for  their  validity  and  reliability  is 
somewhat  weak  (Arvey  &  Campion,  1982;  Harkness,1987).  The  U.S.  Air  Force  does  not 
currently  use  a  routine  interview  process  for  pilot  selection,  other  than  that  conducted  for 
recruiting  purposes,  although  some  components  of  the  Air  Force  do  rely  on  their  own 
procedures.  Units  of  the  Air  National  Guard,  for  instance,  have  used  an  interview  process  with 
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some  success  (Armour,  personal  communication,  October  10,  1987).  Based  on  the  perceived 
success  of  an  interview  process  used  by  the  Air  National  Guard, ,  a  study  was  undertaken  to 
assess  the  validity  of  an  interview  for  selecting  Air  Force  pilot  candidates.  In  particular,  the  issue 
of  Interest  was  whether  instructor  pilots  could  use  a  structured  interview  technique  to  assess  an 
applicant's  potential  for  pilot  training.  The  content  of  the  interview  was  derived  from  a  review  of 
the  instrument  used  by  the  Air  National  Guard  and  through  discursions  with  subject  matter 
experts  of  the  Air  Force  Air  Training  Command  (ATC),  the  organization  responsible  for  training 
all  Air  Force,  Air  National  Guard  and  Air  Force  Reserve  pilot  candidates. 

Siem,  F.  M.,  &  Murray,  M.  W.  (1993).  Personality  factors  affecting  pilot  combat  performance. 
Paper  presented  at  the  35  th  Annual  Military  Testing  Association  Conference, 
Williamsburg,  VA. 

Studies  based  on  pilot  perfonnance  in  combat  suggest  that  individual  differences  in 
personality  characteristics  are  important  to  effective  performance  (Bair,  1952;  Jenkins,  Ewti,  & 
&roll,  1950;  Stanley,  1973;  Youngling,  Levine,  Mochamuk,  &  Weston.  1977).  Nonetheless, 
qualitative  reviews  of  the  literature  have  generally  been  pessimistic  toward  empirical  evidence 
supporting  the  hypothesis  that  personality  characteristics  are  important  to  effective  pilot 
perfonnance,  despite  the  large  number  of  characteristics  examined  using  a  variety  of  different 
instruments  in  a  multitude  of  studies  (Dolgin  &  Gibb,  1988).  One  possible  explanation  for  the 
failure  to  find  stronger  relationships  may  be  due  to  the  lack  of  a  suitable  conceptual  framework 
for  evaluating  results  from  different  studies.  Efforts  to  identify  such  a  framework  have  led  to  a 
consensus  model  of  personality  based  on  the  observation  that  five  global  factors  adequately 
describe  individual  differences  in  personality  traits  (Digman,  1990;  Tupes  &  Christal  1961). 
These  factors,  known  as  the  -Big  Five,”  are  (I)  Extroversion,  (II)  Agreeableness,  (III) 
Conscientiousness,  (IV)  Emotional  Stability,  and  (V)  Culture,  or  Openness  to  Experience  (Costa 
&McCrae,  1992). 

Siem,  F.  M.,  &  Murray,  M.  W.  (1994).  Personality  factors  affecting  pilot  combat  perfonnance:  a 
preliminary  investigation.  Aviation,  Space,  and  Environmental  Medicine,  65(5),  A45- 
A48. 
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Recruitment,  Selection,  and  Training  and  Military  Operations  of  Female  Aircrew.  Paper 
presented  at  the  69th  Symposium  of  the  Aerospace  Medical  Panel. 

Signori,  E.  I.  (1949).  The  Amprior  experiment:  A  study  of  World  War  II  pilot  selection 
procedures  in  the  RCAF  and  RAF.  Canadian  Journal  of  Psychology,  3,  136-150. 

This  article  presents  validity  evidence  for  the  pilot  selection  battery  employed  by  the 
Royal  Canadian  Air  Force  (RCAF).  This  battery  includes  a  variety  of  predictor  variables  ranging 
from  cognitive  ability  to  biodata  to  psychomotor  coordination.  Several  different  criterion 
measures  were  also  used  ranging  from  a  training  pass/fail  criterion  to  various  flight  training  and 
ground  school  ranks.  Results  showed  that  the  RCAF  Visual  Link  Test  was  the  most  valid 
predictor  variable  (zero-order  validities  ranging  from  .  18  for  initial  training  school  rank  to  -57 
for  elementary  flying  training  school  rank).  The  validities  for  the  Aircrew  Information  Sheet 
(biodata)  ranged  from  .01  for  elementary  and  service  flight  training  school  to  .20  for  initial 
training  school  rank.  The  validities  for  the  Aircrew  Interview  Report  Form  (motivation  and 
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attitude  appraisal)  ranged  from  .06  for  elementary  flight  training  school  pass/fail  to  .16  for  initial 
training  school  rank.  The  authors  conclude  that  the  RCAF  battery  compares  favorably  with  the 
1943  U.S.  Air  Force  selection  battery. 

Silva,  J.  M.  (1997).  Using  Psychomotor  Ability  for  Selecting  TOW  Gunners,  (pp.  30). 

Alexandria,  VA:  U.S.  Army  Research  Institute  for  the  Behavioral  and  Social  Sciences. 
The  situation  awareness  (SA)  and  mental  workload  of  56  subjects  were  evaluated  as  they 
monitored  one  or  more  attributes  of  six  objects  moving  systematically  over  a  rectangular  grid. 
Subjects  were  assigned  to  one  of  seven  groups  depending  upon  whether  they  were  to  monitor 
object  locations  (location  task),  object  colors  (color  task),  whether  the  objects  flashed  (flash 
task),  or  some  combination  of  these  three.  Both  task  perfonnance  and  subjective  ratings  were 
used  to  assess  subjects'  awareness  of  the  three  object  attributes.  In  addition,  subjective  ratings  of 
mental  workload  were  collected.  All  subjects  performed  the  monitoring  task  under  four  different 
conditions  formed  from  the  factorial  combination  of  1)  the  probability  that  objects  of  a  certain 
color  would  flash  and  2)  whether  object  colors  remained  consistent  or  changed  during  the  course 
of  a  trial.  The  results  pointed  to  the  usefulness  of  both  flash  and  color  task  perfonnance  as 
measures  of  SA.  Subjects  were  very  poor  at  the  location  task,  suggesting  either  their  location 
awareness  was  poor  or  the  location  task  is  not  a  good  measure  of  that  awareness.  Subjective 
ratings  proved  useful  but  occasionally  dissociated  from  task  performance.  One  possibility  is  that 
subjective  ratings  reflect  rational  inferences  b  the  subjects  rather  than  the  outcome  of  their 
introspections. 

Simon,  E.,  Watts,  D.,  &  Bohnker,  B.  K.  (2008).  Helicopter  mishap  attributed  to  single  seizure. 
Military  Medicine,  173(3),  322-323. 

A  case  report  is  presented  of  a  36-year-old  U.S.  Coast  Guard  aviator  who  had  a  single 
seizure  while  operating  a  helicopter  on  the  ground.  His  seizure  activity  produced  a  loss  of 
consciousness  during  which  he  pushed  the  cyclic  to  the  left  anterior  quadrant  that  resulted  in  a 
ground  mishap.  No  risk  factors  were  identified  in  an  extensive  neurological  workup.  The  current 
guidance  for  handling  seizures  in  military  aviation  personnel  is  reviewed,  along  with 
considerations  for  treatment.  Although  the  military  aviation  selection  process  carefully  screens 
applicants  for  seizure  history  and  potential,  occasional  seizures  in  the  aviation  population  remain 
possible.  Such  events  may  result  in  military  aircraft  mishaps  despite  careful  risk  factor 
surveillance,  as  demonstrated  by  this  case. 
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Inventory  (MMPI):  Military  Pilot  Norms.  Paper  presented  at  the  33rd  Annual  Military 
Testing  Association  Conference,  San  Antonio,  TX. 

Pilot  standards  in  the  military  are  stringent  with  high  physical,  mental  and  psychological 
criteria.  When  testing  military  pilots,  two  areas  of  concern  are  addressed.  The  first  is  the 
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occupational  question  of  whether  this  pilot  is  like  other  pilots  and  is  safe  to  fly  and  able  to 
complete  the  mission.  The  second  is  the  clinical  question  of  whether  this  pilot  has  a  diagnostic 
and  treatable  psychiatric  condition  or  disorder  that  immediately  excludes  the  pilot  from  flying 
until  treatment  is  successfully  completed.  The  MMPI  may  be  helpful  in  answering  these  two 
questions,  but  a  nonnative  sample  of  pilots  has  been  lacking  in  the  past.  Given  these  selection 
and  continuation  standards,  military  pilots  are  expected  to  have  the  same  general  MMPI  profile 
across  time  and  military  services.  It  was  hypothesized  that  "normal"  (not  having  received  any 
psychiatric  diagnosis)  pilot  groups  from  the  US  Air  Force,  Army  and  Navy  have  MMPI  profiles 
not  significantly  different  from  one  another  regardless  of  the  passage  of  time.  A  second 
hypothesis  was  that  groups  of  military  pilots  would  be  significantly  different  from  the  civilian 
nonns  on  at  least  eight  scales:  K-correction  (K),  Hypochondriasis  (Hs),  Hysteria  (Hy), 
Psychopathic  Deviate  (Pd),  Psyhasthenia  (Pt),  Schizophrenia  (SC),  Hypomania  (Ma),  and  Social 
Introversion  (Si)  as  shown  in  a  previous  study  (Fulkerson,  Freud  and  Raynor,  1958). 
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Smith,  G.  (2008).  RAFAAT  &  TSD-PI  as  Predictors  of  Aerospace  Control  Performance.  Paper 
presented  at  the  50th  Annual  International  Military  Testing  Association  Conference, 
Amsterdam,  Netherlands. 

Air  Traffic  &  Air  Weapons  Control  offer  highly  complex,  critical  entry-level  jobs  AEC 
relies  upon  the  same  generic  system  use  to  select  General  Service  Officer  classifications  &  NCM 
occupations  Training  serials  filled  on  =first-passed-the-post‘  basis  Only  difference  for  AEC 
selection  is  interim  CFAT  Total  cut-off  score  at  60th  percentile  AEC  has  experienced  significant 
training  attrition  rate  since  2000  (e.g.,  1999  -  60%,  now  averaging  35%)  Current  selection 
criteria  unable  to  further  decrease  training  attrition  aim  To  determine  predictive  validity  of 
RAFAAT  &  TSD-PI  in  Aerospace  Control  training  &  job  perfonnance. 

Smith,  G.  A.  (2003).  Whom  among  us?  Preliminary  research  on  position  and  personnel  selection 
criteria  for  MALE  UAV  sensor  operators.  Paper  presented  at  the  45th  Annual 
International  Military  Testing  Association  Conference,  Pensacola,  FL. 

Net-centric  warfare  and  interoperability  are  fast  becoming  basic  tenets  of  modem  military 
strategic  thought.  The  Canadian  Forces  and  its  NATO  allies  are  currently  conducting  research 
into  the  effective  use  of  current  and  emerging  technologies  such  as  airborne  sensors  and 
uninhabited  aerospace  vehicles  (UAVs)  to  enhance  their  intelligence,  surveillance,  and 
reconnaissance  (ISR)  capabilities.  Effective  sensor  operation  is  critical  to  the  successful  support 
of  UAVs  to  Canada‘s  joint  and  combined  net-centric  warfare  capability.  The  selection,  training, 
and  employment  of  Canadian  Forces  personnel  as  sensor  operators  will  depend  upon  an  accurate 
analysis  of  this  position4  s  requirements  and  upon  the  determination  of  whom  among  us  has  the 
appropriate  training  and  experience  to  competently  fill  this  vital  ISR  position.  Canadian  Forces 
UAV  experimentation  is  developing  an  understanding  of  the  generic  task  and  knowledge 
requirements  of  the  Medium  Long  Endurance  (MALE)  UAV  Sensor  Operator  position  to  that 
end.  This  paper  discusses  the  methods  and  techniques  used  over  the  course  of  three  major 
research  events  to  detennine  the  position  and  personnel  selection  criteria  for  MALE  UAV  Sensor 
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Operators  and  provide  preliminary  results  from  Canadian  Forces  research  to  date. 
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Airline  Training  Programs.  International  Journal  of  Applied  Aviation  Studies,  10(1),  73- 
93. 

The  2010  Pilot  Source  Study,  commissioned  to  research  the  success  of  pilots  in  initial 
training  for  Part  121  operations,  analyzed  the  training  perfonnance  of  2,156  new-hire  pilots  in 
the  years  2005-2009.  Six  regional  airlines  provided  data  that  was  mined  from  human  resource 
and  pilot  training  files.  Five  university  researchers  independently  analyzed  the  data  and 
integrated  their  results.  The  study  expressed  success  in  terms  of  fewer  extra  training  events  and 
fewer  non-completions  in  regional  airline  training.  Statistically,  the  best  perfonning  pilots  were 
those  who  had  flight  instructor  certificates,  graduated  from  collegiate  accredited  flight  programs, 
received  advanced  (post-Private)  pilot  training  in  college,  graduated  with  collegiate  aviation 
degrees  (any  aviation  discipline),  and  had  between  500  and  1,000  pre-employment  flight  hours. 
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This  test  series  was  developed  during  WWII  and  includes  four  basic  content  areas:  1)  general 
scholastic-related  ability,  2)  mechanical  reasoning,  3)  spatial  reasoning,  and  4)  background 
experiences  and  interests.  Extensive  research  has  shown  that  the  AQTIFAR  was  a  valid  predictor 
of  aviation  training  success.  The  ASTB,  like  the  AQT/FAR,  is  a  paper-and-pencil  test  that  takes 
approximately  2  hours  to  complete.  The  ASTB  was  developed  jointly  by  the  U.S.  Navy  and  the 
Educational  Testing  Service  (ETS)  in  Princeton,  New  Jersey.  The  development  of  questions  for 
the  ASTB  was  based  on  an  extensive  job  and  skill  analysis  conducted  by  ETS  and  the  Navy.  It  is 
broadly  useful  for  aviation  and  naval  officer  training  and  is  comprised  of  6  subtests  that  cover  the 
same  content  areas  as  the  AQT/FAR.  Unlike  earlier  versions  that  targeted  only  attrition,  the  item 
selection  and  scoring  of  the  ASTB  is  based  on  the  ability  to  predict  primary  flight  grades  and 
training  attrition. 

Street,  D.  R.,  &  Dolgin,  D.  L.  (1992).  The  efficacy  of  biographical  inventory  data  in  predicting 
early  attrition  in  Naval  aviation  officer  candidate  training.  Pensacola,  FL:  Naval 
Aerospace  Medical  Research  Laboratory. 

Attrition  in  the  training  of  U.S.  naval  aviation  officer  candidates  represents  a  historic 
problem.  The  early  identification  of  those  likely  to  attrite  during  training  would  significantly 
reduce  overall  training  expenditures.  In  this  study,  we  assessed  the  value  of  biographical 
information  for  predicting  early  attrition  at  the  indoctrination  level  of  naval  aviation  officer 
training.  We  selected  a  random  sample  of  1551  aviation  officer  candidates  and  naval  aviation 
cadets  for  analysis.  The  subjects  selected  had  taken  the  Aviation  Selection  Test  Battery  (ASTB) 
between  1987  and  1990  and  had  completed  the  aviation  indoctrination  program  operated  by  the 
Naval  Aviation  Schools  Command  in  Pensacola,  Florida.  A  principal  component  factor  analysis 
of  Biographical  Inventory  items  was  conducted  with  those  who  passed  (N  -  1 176)  and  also  with 
those  who  attrited  (N  =  375)  basic  aviation  indoctrination.  The  resultant  factors  were  then  forced 
into  a  discriminant  function  analysis  to  detennine  if  the  factors  obtained  were  different  for  the 
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two  groups.  We  found  that  the  factors  were  significantly  different  for  the  two  groups.  The  results 
indicate  that  biographical  data  may  be  useful  in  identifying  candidates  who  are  most  likely  to 
attrite  early  from  naval  aviation  training. 

Street,  D.  R.,  &  Dolgin,  D.  L.  (1993).  An  evaluation  of  personality  testing  and  the  Five-factor 
model  in  the  selection  of  landing  craft  air  cushion  vehicle  crew  members.  Naval  Air 
Station  Pensacola,  FL:  Naval  Aerospace  Medical  Laboratory. 

Street,  D.  R.,  &  Dolgin  ,  D.  L.  (1994).  Computer-Based  Psychomotor  Tests  in  Optimal  Training 
Track  Assignment  of  Student  Naval  Aviators,  (pp.  18).  Pensacola,  FL:  Naval  Aerospace 
Medical  Research  Laboratory. 

The  purpose  of  our  investigation  was  to  determine  if  computer-based  selection  tests  could 
predict  training  track  assignment  for  student  naval  aviators.  This  study  evaluated  the  predictive 
efficacy  of  an  experimental  battery  of  computer-based  pilot  selection  tests  for  training 
classification.  Student  naval  aviators  are  currently  assigned  to  an  aircraft  training  track  based 
primarily  on  perfonnance  in  primary  training.  Students  were  tested  on  the  experimental  test 
battery  and  classified  into  one  of  three  aircraft  training  tracks  based  on  their  test  scores.  The 
resulting  classifications  were  compared  to  actual  selections  made  as  the  students  progressed 
through  naval  aviation  training.  Using  a  sample  of  237  students,  linear  analyses  were  conducted 
to  evaluate  the  efficacy  of  predicted  decisions.  The  unique  contribution  of  the  experimental 
battery  was  detennined  by  comparing  scores  on  the  experimental  battery  to  scores  on  the 
Navy/Marine  Corps  Aviation  Selection  Test  Battery,  a  paper-and-pencil  pilot  selection  test  used 
by  the  United  States  Navy  and  Marine  Corps,  and  student  primary  flight  training  grades.  A 
significant  classification  model  including  one  of  the  experimental  selection  tests  was  derived. 

The  model  was  able  to  significantly  predict  fast  attack  pipeline  selections  before  flight  training. 

Street,  D.  R.,  Dolgin,  D.  L.,  &  Helton,  K.  T.  (1993).  Personality  tests  in  an  enhanced  selection 
model.  Paper  presented  at  the  7th  International  Symposium  on  Aviation  Psychology, 
Columbus,  OH. 

Street,  D.  R.,  Helton,  K.  T.,  &  Dolgin,  D.  L.  (1992).  Personality  Tests  to  Predict  Success  in  Navy 
Pilot  Training.  Paper  presented  at  the  34th  Annual  Military  Testing  Association 
Conference,  San  Diego,  CA. 

The  increasing  cost  of  training  aircrew  to  operate  modem  naval  aircraft  and  the 
simultaneous  decline  in  retention  rate  for  these  same  trained  aircrew  increase  the  importance  of 
utilizing  the  best  selection  methods  available.  This  importance  is  underscored  by  the  fact  that 
every  aircrew  selectee  who  fails  to  complete  training  contributes  to  a  potential  operational 
personnel  shortage  if  expected  replacements  necessary  to  maintain  military  readiness  do  not 
materialize  as  planned.  Pilot  selection  research  to  date  has  generally  focused  on  the  testing  of 
various  psychomotor  and  cognitive  abilities  (Carretta,  1986;  Davis,  1989;  Dolgin  &  Gibb,  1989; 
Hilton  &  Dolgin,  1990).  While  these  abilities  would  seem  logically  necessary  for  successful 
performance  in  flight  training,  some  failures  may  be  due,  at  least  in  part,  to  personality  and/or 
motivational  factors  (Helmreich,  1982).  Historically,  researchers  have  tried  to  find  the  ideal 
aviator  personality  profile  among  numerous  personality  measures.  This  ideal  aviator  personality 
profile  has  often  been  anecdotally  called  -the  right  stuff.”  Promising  results  have  been  found  in 
identifying  characteristics  that  improve  the  likelihood  of  later  success  in  aviation  such  as 
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persistence,  motivation,  coolness  under  pressure  (clear  thinking),  and  novel  problem  solving 
(e.g.,  Retzlaff  &  Gibertini,  1987).  Other  researchers  have  considered  personality  factors  with 
varying  degrees  of  success  (Dolgin  &  Gibb,  1989;  Hunter  &  Burke,  1991).  Certain  personality 
characteristics  or  traits  may  correlate  highly  with  success  in  initial/primary  flight  training.  For 
example,  interpersonal  orientation,  self-assertiveness,  and  achievement  motivation  are  associated 
with  pilot  attitude  and  performance  (Helmreich,  Sawin,  dc  Carsrud,  1986).  Important 
developments  in  personality  assessment  have  included  attempts  to  avoid  response  bias  by 
masking  the  personality  dimension  of  interest  and  to  screen  for  positive  attributes,  in  contrast  to  a 
past  emphasis  on  psychopathology  (Picano,  1991). 

Street,  D.  R.,  Helton,  K.  T.,  &  Dolgin,  D.  L.  (1992).  The  unique  contribution  of  selected 

personality  tests  to  the  prediction  of  success  in  naval  pilot  training.  Naval  Air  Station 

Pensacola,  FL:  Naval  Aerospace  Medical  Research  Laboratory. 

This  study  concerns  the  relationship  of  naval  flight  training  perfonnance  to  scores  on  the 
Aviation  Qualification  Test/Flight  Aptitude  Rating  (AQT/FAR)  and  the  automated  Pilot 
Personality  Questionnaire  (PPQ).  We  analyzed  a  sample  of  21 1  pilot  candidates  who  had  taken 
the  AQT/FAR  and  PPQ.  We  found  that  the  PPQ  competitiveness  scale  and  three  of  the 
AQT/FAR  subtest  score  means  were  significantly  different  (p  <  .05)  for  those  who  passed  (N  - 
168)  and  those  who  attrited  (N  -  43)  flight  training.  Discriminant  analysis  yielded  a  linear 
composite  of  the  AQT/FAR  and  PPQ  subtest  variables  that  could  be  used  to  classify  the  students 
according  to  the  likelihood  of  passing  or  attriting  during  flight  training.  The  resulting 
discriminant  function  explained  9%  of  the  variance  in  the  pass/attrite  criterion  (r  =  .30).  We 
found  that  a  50%  reduction  in  attritions  could  be  attained  with  a  23%  increase  in  false  rejections. 
The  regression  analysis  as  significant  (p  <  .01)  and  indicated  that  three  scales  of  the  PPQ  and  the 
AQT  and  FAR  scores  accounted  for  unique  variance  in  a  linear  prediction  equation.  The  FAR 
and  PPQ  competitiveness  scale  were  the  most  powerful  predictors  of  overall  flight  training 
success. 

Street,  D.  R.,  Helton,  K.  T.,  &  Nontasak,  T.  (1993).  An  evaluation  of  personality  testing  and  the 

five-factor  model  in  the  selection  of  landing  craft  air  cushion  vehicle  crew  members. 

Pensacola,  FL:  Naval  Aerospace  Medical  Research  Laboratory. 

The  purpose  of  our  investigation  was  to  determine  if  personality  testing  and  a  five-factor 
model  could  improve  the  selection  of  Landing  Craft  Air  Cushion  (LCAC)  vehicle  crew 
members.  Vehicle  crew  members  for  the  LCAC  are  currently  selected  by  their  performance  on  a 
computer-based  psychomotor  selection  system.  The  various  psychomotor  tests  in  the  selection 
system  have  demonstrated  predictive  validity  in  LCAC  crew  training.  Certain  personality 
characteristics  may  also  be  involved  in  the  LCAC  vehicle  crew  training  success.  In  fact,  various 
researchers  have  found  that  personality  testing  may  improve  the  selection  of  Navy/Marine  Corps 
aviators.  Increasing  evidence  indicates  that  a  five-factor  model  may  be  useful  in  describing  the 
personality  characteristics  involved  in  training  success.  We  believe  that  a  five-factor  model  may 
improve  the  selection  system  used  for  LCAC  vehicle  crew  members.  A  principal  component 
analysis  with  varimax  rotation  was  conducted  to  determine  the  underlying  structure  of  the  Adult 
Personality  Inventory  with  168  LCAC  crew  candidates.  The  resulting  factor  scores  were  then 
statistically  analyzed  to  determine  the  relation  of  the  personality  factor  scores  and  the 
perfonnance-based  test  to  an  underway  grade  in  training  criterion.  The  results  indicated  that  one 
personality  factor,  openness,  significantly  improved  predictions  of  the  criterion  (p  <  0.05).  Based 
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on  these  results,  we  believe  that  personality  testing  would  improve  the  selection  of  LCAC 
vehicle  crew  members. 

Strieker,  L.  J.  (1993).  The  Navy's  Biographical  Inventory:  What  Accounts  for  Its  Success?  Paper 
presented  at  the  25th  Annual  Military  Testing  Association  Conference,  Williamsburg, 

VA. 

The  Biographical  Inventory  in  the  Navy's  aviation  selection  battery  is  interesting  and 
important  from  both  historical  and  psychometric  perspectives.  This  traditional  inventory, 
composed  of  heterogeneous  items  selected  and  keyed  to  predict  retention  vs.  attrition  of  student 
naval  aviators  in  flight  training,  has  evolved  over  the  years  but  can  be  traced  back  to  the  one  used 
in  World  War  II.  This  device  has  consistently  been  one  of  the  most  valid  predictors  of  retention 
vs.  attrition  in  the  battery,  overshadowing  tests  of  general  ability,  mechanical  comprehension, 
spatial  ability,  and  aviation  infonnation  (e.g.,  Fiske,  1947)  It  has  been  speculated  that  the 
inventory  tapes  maturity  and  risk  taking  (Petho,  1980),  but  the  reasons  for  its  success  have  so  far 
not  been  explored.  Accordingly,  the  purpose  of  this  study  was  to  assess  the  dimensions 
underlying  the  inventory  and  their  relations  with  retention  vs.  attrition  of  aviators  in  naval 
aviation  training.  (A  parallel  investigation  of  flight  officers  is  underway.) 

Strieker,  L.  J.  (2005).  The  biographical  inventory  in  naval  aviation  selection:  Inside  the  black 
box.  Military  Psychology,  14(1),  55-67. 

A  biographical  inventory  has  been  used  in  the  selection  of  students  for  naval  aviation 
training  since  World  War  II,  and  its  validity  in  predicting  their  retention  in  this  training  has  been 
well  established.  This  study  investigated  the  constructs  underlying  the  inventory  and  their 
relations  to  student  retention  criteria.  A  factor  analysis  of  the  items  on  the  inventory  for  student 
pilots  identified  five  factors.  One  factor,  being  a  commissioned  officer,  appeared  to  account  for 
the  inventory4  s  validity. 
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Discusses  various  functions  of  the  Committee  on  Classification  of  Personnel  in  the  Army: 
(1)  classifying  personnel  according  to  their  military  qualifications  (2)  establishing  the  Trade- 
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personnel  work  to  staff  corps  troops  (5)  establishing  the  Central  Personnel  Bureau  (6)  appointing 
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Maxwell  Air  Force  Base,  Alabama:  Air  University  Press. 

’The  Anny  and  Its  Air  Corps'  was  James  P.  Tate's  doctoral  dissertation  at  Indiana 
University  in  1976.  During  the  past  22  years,  Tate's  remarkable  work  has  gained  wide  acceptance 
among  scholars  for  its  authoritative  and  well-documented  treatment  of  the  formative  years  of 
what  eventually  became  the  United  States  Air  Force.  Thoroughly  researched  but  bearing  its 
scholarship  lightly,  Tate's  narrative  moves  swiftly  as  it  describes  the  ambitions,  the  frustrations, 
and  the  excruciatingly  slow  march  to  final  success  that  never  deterred  the  early  airmen.  'The 
Anny  and  Its  Air  Corps’  is  one  in  a  series  of  airpower  history  classics  that  the  Air  University 
Press  is  pleased  to  bring  before  a  wider  audience. 

Taylor,  C.  W.,  Murray,  S.  L.,  Ellison,  R.  L.,  &  Majesty,  M.  S.  (1971).  Development  of 

motivation  assessment  techniques  for  Air  Force  officer  training  and  education  programs: 
Motivation  for  pilot  training.  Brooks  Air  Force  Base,  TX:  Air  Force  Human  Resources 
Laboratory. 

The  authors  attempted  to  develop  a  motivational  screening  device  that  would  reduce  the 
number  of  voluntary  eliminees  from  undergraduate  pilot  training  (UPT)  and  to  develop  an 
instrument  which  could  be  used  to  measure  changes  in  motivation  as  subjects  progress  through 
pilot  training  (and  later  on  the  job).  Both  an  a  priori  and  an  empirical  keying  approach  were  used 
to  develop  measures  intended  to  predict  several  different  types  of  attrition.  Two  hundred  twenty- 
four  self  initiated  eliminees  (SIE)  from  UPT  identified  their  reasons  for  attriting  and  these  were 
subsequently  examined  to  develop  subcategories  (i.e.,  criterion  measures)  that  could  be  used  to 
classify  eliminees  (e.g.,  SIE,  flying  deficiency,  medical  elimination,  etc.).  The  initial  item  pool 
for  predictor  battery  development  contained  2500  items,  899  of  which  were  included  in  the  first 
version  of  the  battery.  The  predictor  battery  consisted  of  two  biographical  inventories  (Bis)  with 
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approximately  300  items  each  and  an  Activities  Index,  which  was  a  300  item  personality  test. 

The  battery  was  administered  to  all  active  students  in  the  Officer  training  School  (OTS),  which 
was  operated  at  Lackland  AFB  between  January  and  November  1970.  Of  the  a  priori  scales,  only 
the  BI  creativity  key  demonstrated  predictive  validity  with  total  attrition  (r  =  -.  10,  p  <  .05).  All 
other  validities  for  a  priori  BI  keys  and  for  all  of  the  other  criteria  were  non-significant.  Of  the  a 
priori  personality  scales,  Abasement,  Change,  Energy,  Science,  Sensuality,  Audacity  and 
Motivation  all  demonstrated  marginal  negative  validity  for  several  of  the  attrition  measures 
(generally  on  the  order  of-.  10  to  -.  16).  The  validities  for  the  Harm  Avoidance  scale  ranged 
from  .09  (ns)  for  elimination  due  to  flying  deficiency  to  .18  (p  <  .01)  for  UPTIOTS-SIE. 
Supplication  also  correlated  positively  with  attrition,  although  the  validity  coefficients  were 
generally  small.  The  empirically  derived  scales  resulted  in  moderately  large  validity  coefficients 
(generally  in  the  .20s  and  -30s)  for  almost  all  the  attrition  criteria,  except  for  elimination  due  to 
flying  deficiency.  They  also  correlated  significantly  with  self-rated  lack  of  dedication  to 
complete  UPT  (correlations  ranged  from  .38  @  <  .01)  for  flying  deficiency  to  .72  @  <  .01)  for 
UPT/OTS-SIE).  Generally,  the  a  priori  scales  only  accounted  for  a  small  proportion  of  attrition 
variance.  Significantly  more  positive  results  were  obtained  using  the  empirically  developed 
scales. 
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Frasca  simulator,  age  50-69,  correlated  factors  with  perfonnance,  speed/working  memory 
conelates  most  with  overall  flight  perfonnance,  age  improved  prediction,  motor  performance  not 
age  dependent. 
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Good  visual  contrast  sensitivity  (CS)  is  often  described  as  a  visual  capability  important 
for  success  as  a  military  aviator  and  so  has  been  suggested  as  a  physical  standard  for  personnel 
selection  and  retention.  To  evaluate  this  idea,  we  measured  the  CS  of  135  U.S.  Navy  fighter 
pilots  ranging  in  age  from  24  to  44  years  (mean  =  30.20,  S.D.  =  4.06)  and  compared  these  to  the 
CS  of  non-aviators.  We  obtained  the  non-aviator  data  from  published  studies  of  other 
investigators  who  used  similar  procedures  with  the  same  widely  used,  commercially  available 
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apparatus  (Nicolet  CST  2000).  In  addition  to  this  comparison,  we  correlated  the  pilots'  CS  with 
their  air-to-air  target  detection  distances  measured  during  air  combat  maneuver  training  and  to 
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leniency  or  severity  effects.  Results  from  the  field  tests,  along  with  suggestions  from  proponent 
review  committees  and  Project  A  staff,  were  used  to  modify  and  prepare  the  nine  sets  of  rating 
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Determining  the  characteristics  of  successful  military  pilots  requires  two  types  of 
assessments  of  individuals  .  First,  it  is  necessary  to  define  and  measure  their  personal 
characteristics  and,  second,  it  is  necessary  to  array  them  on  some  continuum  of  success.  These 
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invest  the  stimulus  materials  with  hi  own  wishes,  impulses,  fantasies,  and  values  -in  other  words, 
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Procedures  for  screening  and  selecting  applicants  for  USAF  Officer  Candidate  School 
(OCS)  were  modified  early  in  1952.  The  new  composite  score  consisted  of  an  officer  quality 
score  derived  from  the  Aviation  Cadet  Qualifying  Test  (ACQT),  a  score  based  on  board 
interview,  and  other  scores  awarded  for  years  of  college  completed,  airman  technical  schools 
completed,  airman  rank,  and  length  of  service,  weighted  according  to  their  presumed  importance 
to  success  in  OCS  and  to  later  officer  perfonnance.  Scores  on  the  composite  and  its  components 
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significantly  related  to  academic  grades.  4  variables  were  significantly  related  to  military  grades 
(service,  rank,  and  interview  positively,  and  college  negatively).  Further  analysis  suggested  that 
modified  weighting  of  the  components  could  improve  the  prediction  of  both  criteria. 
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This  report  is  a  nontechnical  review  of  the  research  programs  with  a  listing  of  75 
scientific  publications  produced  by  Air  Force  personnel  research  in  this  area.  Contributions  of 
psychological  tests  to  officer  selection  for  flying  training  and  technical  training  are  summarized. 
5  graphic  figures  illustrate  the  efficiency  of  tests  in  selection.  The  directions  in  which  current 
research  is  moving  are  indicated.  Aptitude  tests  are  generally  used  in  officer  selection  programs 
but  are  not  yet  fully  exploited  in  officer  classification. 
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Turnbull,  G.  J.  (1992).  A  review  of  military  pilot  selection.  Aviation,  Space,  and  Environmental 
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The  author  reviews  the  various  methods  that  have  been  used  to  select  pilots  over  the 
years.  This  comprehensive  review  begins  with  a  description  of  the  "selection"  method  used  by 
the  Wright  brothers  in  191  3  (i.e.,  they  flipped  a  coin)  to  decide  who  would  fly  their  plane  and 
includes  the  present-day  multivariate  approach  to  selecting  pilots.  He  describes  the  historical 
depiction  of  pilots  as  sportsmen  with  initiative  and  humor,  as  well  as  high-spirited,  gregarious 
and  lacking  in  imagination.  The  RAF  developed  the  first  basic  aptitude  tests  used  to  select  pilots 
during  WWI,  but  these  efforts  receded  after  the  war  ended.  However,  by  1941  the  high  incidence 
of  failure  in  RAF  pilot  training  became  a  major  problem  and  the  focus  on  pilot  selection  once 
again  increased.  This  cycle  is  contrasted  against  the  remarkable  success  of  the  German  Luftwaffe 
selection  procedures.  The  Germans  used  a  combination  of  psychological  and  aptitude  testing  and 
were  very  successful  in  selecting  pilots.  The  author  reviews  the  use  of  personality  tests  in  general 
and  concludes  that  they  have  had  some  success  in  predicting  pilot  training  performance,  but  that 
their  susceptibility  to  faking  is  a  major  failing.  The  use  of  "objective"  tests  (e.g.,  the  Rod  and 
Frame  test)  is  also  reviewed.  He  concludes  that  while  there  is  no  one  reliable  way  to  select  pilots, 
there  is  considerable  evidence  suggesting  that  the  measurement  of  the  "right  stuff  is  feasible. 
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The  report  presents  an  abbreviated  account  of  developments  in  military  psychology  in  the 
Anny,  beginning  with  the  general  ability  tests  developed  and  used  in  World  War  1.  A 
chronological  listing  of  "Events  and  Organizational  Change"  is  accompanied  by  interpretive 
comment  in  terms  or  "Research  Achievements  and  Directions."  The  following  periods  are 
treated:  Beginning,  1917  to  1921,  Interim  Period,  192 lto  1939,  World  War  II,  1939-1945,  Early 
Post-War  Years,  1945  to  1951,  Period  of  Transition,  1951  to  1960,  Developments,  1960  to  1969, 
and  1969  to  the  Present. 
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This  report  presents  results  of  an  evaluation  of  the  Army's  17  5/40  Initial  Entry  Rotary 
Wing  (IERW)  training  program.  The  program  consists  of  175  flight  and  40  simulator  hours.  In 
the  last  training  phase  of  the  program,  students  are  divided  into  two  training  tracks,  i.e.,  Utility 
Helicopter  and  Aeroscout.  Data  were  gathered  from  IERW  training  files  and  through 
questionnaires  administered  to  instructors  at  the  Army  Aviation  Center  and  to  unit  instructors, 
supervisors,  and  program  graduates  at  aviation  field  units  world-wide.  Data  were  gathered  on 
graduates  of  both  the  175/40  program  and  the  180/20  program  that  preceded  it,  and  comparisons 
between  the  two  programs  are  made.  Results  and  conclusions  are  presented  with  reference  to 
nine  specific  evaluation  objectives.  Major  conclusions  are:  (1)  the  175/40  IERW  course  is 
accomplishing  its  objectives;  (2)  the  175/40  course  is  an  improvement  over  the  180/20  course; 
and  (3)  proficiency  progression  and  individualized  training  can  play  an  effective  role  in  IERW 
training. 
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between  the  two  programs  are  made.  Results  and  conclusions  are  presented  with  reference  to 
nine  specific  evaluation  objectives.  Major  conclusions  are:  (1)  the  175/40  IERW  course  is 
accomplishing  its'  objectives;  (2)  the  175/40  course  is  an  improvement  over  the  180/20  course; 
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training. 
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The  purpose  of  this  paper  is  to  present  initial  findings  on  utility  of  two  psychomotor  tests 
for  improved  selection  of  Air  Force  pilots.  During,  and  for  a  few  years  following  World  War  II, 
the  predecessor  organization  of  the  Air  Force  Human  Resources  Laboratory  conducted  an 
extensive  program  of  psychomotor  research,  and  selected  psychomotor  tests  developed  under 
this  program  were  an  integral  part  of  the  World  War  II  Aircrew  Classification  Batteries.  Much  of 
this  early  effort  has  been  described  by  Melton  (1947).  Generally,  it  was  found  that  such 
assessments  had  validity  for  predicting  eliminations  from  pilot  training  beyond  that  achieved 
with  a  battery  of  paper  and  pencil  tests.  Use  of  psychomotor  assessments  in  the  Air  Force  pilot 
selection  testing  program  was  discontinue  in  the  early  1950‘s  because  of  the  expense  and 
difficulty  of  maintaining  and  calibrating  the  required  equipment  under  decentralized  testing 
conditions. 
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During  the  two  academic  years  1917-18  and  1918-19  the  Anny  Test  Alpha  or  its 
equivalent,  Form  E,  was  given  to  the  freshman  classes  of  nearly  all  the  colleges  at  the  University 
of  Minnesota  In  some  of  the  colleges  the  results  were  used  as  an  aid  in  diagnosing  the  causes  of 
student  failures.  In  other  colleges  the  purpose  was  purely  an  experimental  one.  The  use  of  the 
tests  has  revealed  some  significant  information  regarding  the  students  of  the  various  colleges. 

For  instance,  over  eighty  per  cent  of  the  student  body  of  the  University  as  a  whole  were  found  to 
come  from  the  upper  fifteen  to  twenty  per  cent  of  the  population  in  general.  With  the  exception 
of  two  of  the  individual  tests  the  women  of  the  several  colleges  did  just  as  well  or  even  better 
than  the  men  of  the  same  colleges,  but  in  these  two  tests — the  range  of  infonnation  test  and  the 
arithmetic  problems  test — from  seventy  to  seventy-five  per  cent  of  the  men  did  as  well  or  better 
than  the  median  woman.  Making  correction  for  the  excess  of  overlapping  due  to  the  use  of  a 
single  test,  from  sixty-five  to  seventy  per  cent  of  the  men  may  be  expected  to  do  as  well  or  better 
in  solving  arithmetic  problems  and  to  have  as  wide  or  a  wider  range  of  the  kind  of  information 
called  for  m  the  Anny  Tests  than  has  the  median  woman  of  the  same  college. 
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This  study  examined  the  utility  of  Jackson‘s  Personality  Research  Fonn  (PRF)  in  the 
selection  of  aircrew  in  the  Canadian  Forces.  A  total  of  1962  male  candidates  completed  either  the 
English  or  French  version  of  Form  E.  Major  findings  focused  on  the  validity  scales,  anglophone 
versus  francophone  differences  on  the  22  scales  and  the  predictive  validity  of  the  scales  against 
perfonnance  in  flying  training.  Results  show  that  while  Infrequency  scores  are  within  the  range 
reported  by  Jackson,  the  Desirability  scores  obtained  were  very  high.  There  are  also  some 
significant  correlations  between  Desirability  scores  and  scores  on  other  trait  scales.  There  were  a 
number  of  differences  between  perfonnance  of  anglophone  and  francophone  subjects  and  these 
will  be  discussed,  together  with  other  early  stage  psychometric  evaluations  of  the  Form.  Finally, 
the  PRF  may  prove  useful  in  the  counseling  of  candidates  who  are  interested  in  becoming 
military  pilots. 
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Current  diagnostic  electroencephalogram  (EEG)  investigations  in  aircrew  selection  and 
certification  lack  both  standardization  and  reference  to  universally  applicable  criteria  for  their 
effective  use.  Extrapolation  from  clinical  EEG  studies  may  not  be  appropriate.  Recent  studies  on 
serial  EEGs  in  aircrew  are  lacking,  whereas  follow-up  of  individuals  who  failed  certification  is 
nonexistent.  Population-based  EEG  studies  in  healthy  subjects  are  generally  underpowered  to 
establish  the  significance  of  pathological  EEG  findings.  Advanced  digital  video/EEG  recording, 
in  combination  with  standardization  of  data  exchange  formats  and  automated  detection  of 
pathological  grapho-elements,  is  cost  effective  when  carried  out  for  extended  periods,  e.g., 
during  flight  simulator  sessions.  Extensive  databases  of  serial  video/EEG  records  in  aircrew  may 
thus  be  easily  obtained  and  validated  over  time.  Prognostic  inferences  on  the  significance  of 
pathological  EEG  discharges  may  subsequently  be  derived  from  these  databases. 
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rating  for  military  aviation  (ARMA)  among  USAF  flight  surgeons.  Aviation,  Space,  and 
Environmental  Medicine,  64(12),  1086-1993. 

The  Adaptability  Rating  for  Military  Aviation  (ARMA)  is  that  portion  of  the  initial  flight 
physical  that  assesses  an  aviator  candidate's  motivation  for  and  potential  adaptability  toward  an 
aviation  career.  A  survey  was  mailed  to  all  USAF  operational  flight  surgeons  in  the  continental 
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U.S.  to  describe  the  frequency  and  distribution  of  ARMA  usage  and  attitudes.  Descriptive 
statistics  suggest  that  the  ARMA  is  used  suboptimally  in  accordance  with  current  USAF 
regulation.  ARMA  training,  flight  surgeon  satisfaction  and  lack  of  regulation  clarity  are 
described  and  discussed.  More  flight  surgeons  are  dissatisfied  with  the  ARMA  than  are  satisfied, 
and  the  regulation  is  perceived  as  unclear  in  the  area  of  final  disposition  for  candidates  with 
equivocal  ARMA’s.  A  post-hoc  analysis  to  rule  out  the  influences  of  rank,  gender,  experience 
and  residency  training  was  perfonned.  Residency  training  in  Aerospace  Medicine  is  beneficial  in 
terms  of  doing  an  ARMA,  when  required,  and  covering  recommended  areas.  Females  and  those 
with  less  than  1  year  experience  perfonn  an  ARMA  more  frequently  than  males  and  experienced 
flight  surgeons.  Despite  the  limitations  of  the  current  ARMA,  it  should  not  be  abandoned. 
Recommendations  to  improve  it  are  provided.  Doing  better  ARMA’s  can  lead  to  decreased 
illness,  injury,  accidents,  and  attrition. 

Vernon,  P.  E.,  &  Parry,  J.  B.  (1949).  Personnel  Selection  in  the  British  Forces.  London: 
University  of  London  Press. 

Viteles,  M.  S.  (1942).  An  historical  introduction  to  aviation  psychology:  Civil  Aeronautics 
Administration,  Division  of  Research. 

Viteles,  M.  S.  (1945).  The  Aircraft  Pilot:  5  Years  of  Research.  A  summary  of  outcomes. 
Psychological  Bulletin,  42(8),  489-526. 

Committee  on  Selection  and  Training  of  Aircraft  Pilots  In  1939  the  Civil  Aeronautics 
Authority  (now  the  Civil  Aeronautics  Administration)  undertook  an  ambitious  program  of 
training  civilian  pilots.  The  purpose  of  this  was  to  make  young  men  and  young  women  air- 
minded  and  to  prepare  the  present  generation  of  young  people  to  fly  the  private  and  commercial 
planes  of  the  future.  This  program,  known  as  the  Civilian  Pilot  Training  program,  was  operated 
through  the  universities  of  the  country,  making  use  of  already  established  facilities  in  the  hands 
of  private  operators  while  encouraging  others  to  set  up  similar  facilities.  The  first  phase  of  the 
Civilian  Pilot  Training  program  called  for  instruction  of  10,000  pilots,  which  was  quickly 
expanded  to  the  number  of  50,000.  Almost  simultaneously  with  the  fonnulation  of  the  program, 
largely  through  the  efforts  of  Robert  Hinckley,  at  that  time  Chairman  of  the  Civil  Aeronautics 
Authority  and  Dean  R.  Brimhall ,  Director  of  Research,  funds  were  set  aside  for  research  on 
selection  and  training  of  civilian  aircraft  pilots.  This  was  done  in  the  belief  that  an  extended 
program  of  civilian  pilot  training  should  make  use  of  every  possible  scientific  aid  for  selecting 
those  most  competent  to  fly;  for  detennining  the  best  methods  of  training;  for  the  appraisal  of 
flight  achievement,  and  for  safe-guarding  the  adjustment  of  the  pilot.  Moreover,  it  was 
recognized  that  this  large  scale  training  program  provided  unusual  opportunities  for  renewing  the 
study  of  problems  related  to  the  human  side  of  aviation  which  had  been  initiated  during  World 
War  I  and  abandoned  almost  immediately  with  the  signing  of  the  Armistice. 
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Voas,  R.  B.  (1959).  Vocational  interests  of  naval  aviation  cadets:  Final  results.  Journal  of 
Applied  Psychology,  43,  70-73. 

This  study  attempts  to  determine  whether  interest  patterns,  as  measured  by  the  Kuder 
Preference  Record  (KPR),  differ  between  students  who  successfully  complete  flight  training  and 
those  who  do  not.  The  KPR  is  a  standard  interest  inventory  that  consists  of  nine  scales: 
Mechanical,  Computational,  Scientific,  Persuasive,  Artistic,  Literacy,  Musical,  Social  Service 
and  Clerical.  This  was  a  follow-up  study  for  work  completed  by  Rosenberg  and  Izard  (1954), 
which  found  that  students  who  failed  flight  training  scored  lower  on  the  Mechanical  and 
Scientific  scales  and  higher  on  the  Persuasive,  Literacy  and  Musical  scales  than  did  those 
students  who  passed  flight  training.  Six  hundred  and  five  aviation  cadets  participated:  465  who 
successfully  completed  training,  74  who  withdrew  at  their  own  request  and  66  who  failed  at 
some  point  during  flight  training  or  were  eliminated  for  medicaVphysical  reasons.  The  author 
constructed  an  empirically  keyed  Voluntary  Withdrawal  (VW)  scale  based  on  results  from 
Rosenberg  and  Izard.  For  those  scales  that  differentiated  successful  cadets  from  unsuccessful 
cadets,  a  score  of"  1"  was  assigned  to  those  items  that  unsuccessful  cadets  endorsed  and  a  score 
of  "0"  was  assigned  to  those  items  that  successful  cadets  endorsed.  A  high  score  on  the  VW  scale 
indicated  a  pattern  of  interests  similar  to  cadets  who  had  failed  flight  training.  Results  of  this 
study  showed  that  of  the  nine  KPR  scales,  significant  differences  between  successful  and 
unsuccessful  cadets  were  only  found  for  the  Mechanical  and  Scientific  scales.  In  addition,  the 
cadets  who  voluntarily  withdrew  from  training  scored  significantly  higher  on  the  VW  scale  than 
cadets  who  succeeded,  although  there  was  quite  a  bit  of  shrinkage  in  the  cross  validity  sample  (r 
=  .56  compared  to  r  =  .17).  When  scores  on  the  Mechanical  Comprehension  Test  were  held 
constant,  the  differences  between  the  successful  and  unsuccessful  cadets  on  the  VW  scale 
became  nonsignificant.  Thus,  the  validity  of  the  VW  scale  was  apparently  based  mostly  on  its 
relationship  to  mechanical  ability. 
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This  study  examines  the  effects  of  stress  tolerance  on  a  purified  success  in  training 
criterion.  Subjects  were  1540  flight  trainees  who  were  participating  in  decompression  chamber 
classes.  Stress  tolerance  was  operationalized  as  whether  or  not  subjects  replaced  their  air  mask 
during  a  chamber  ride  or  experienced  ear  blocks.  Flight  training  criteria  included  poor 
perfonnance  leading  to  failure  in  training  or  voluntary  withdrawal,  and  an  indication  of  "anxiety 
toward  flying"  (assessed  in  an  unstructured  exit  interview).  Subjects  were  classified  into  one  of 
three  groups  at  the  end  of  training:  (1)  "S"  group  were  those  who  successfully  completed 
training;  (2)  "P"  group  were  those  who  failed  (this  group  was  subsequently  divided  into  "PA"  - 
poor  performance  with  anxiety  and  "PN"  -  poor  performance  without  anxiety);  and  (3)  "M" 
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group  made  up  of  all  subjects  who  did  not  complete  training  for  various  other  reasons.  Results 
indicated  that  those  subjects  who  demonstrated  anxiety  in  the  chamber  ride  were  more  likely  to 
demonstrate  anxiety  during  flight  training,  that  is,  the  S  group  demonstrated  considerably  less 
anxiety  than  the  P  group  during  the  chamber  ride.  In  addition,  the  PN  group  demonstrated  less 
anxiety  than  did  the  PA  group.  Also,  the  PN  group  did  not  differ  from  either  the  S  or  M  groups  in 
level  of  anxiety. 
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techniques  used  to  select  pilots  for  the  ADF;  and  that  aptitude  test  scores  (via  Pilot  Index) 
continue  to  be  used  as  a  method  of  selecting  prospective  flight  screening  candidates.  Future 
research  will  examine  the  validity  of  current  selection  procedures  for  the  full  continuum  of 
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This  report  describes  a  study  conducted  by  Micro  Analysis  and  Design,  Inc.,  for  the  U.S. 
Anny  Research  Laboratory  (ARL).  One  area  of  research  examined  by  ARL  was  the  staffing 
required  to  operate  tactical  unmanned  aerial  vehicles  (TUAVs).  The  primary  objective  of  the 
study  was  to  use  simulation  modeling  to  analyze  how  fatigue,  crew  size,  and  rotation  schedule 
affect  operator  workload  and  performance  during  the  control  of  a  TUAV.  Computer  simulation 
models  were  developed  with  the  Micro  Saint  Discrete  Event  Simulation  software  to  simulate  the 
tasks  that  operators  perform  when  controlling  a  TUAV.  These  models,  which  contain  system- 
specific  attributes  of  the  Shadow  2001  TUAV,  included  a  fatigue  function  to  predict  perfonnance 
effects  for  day  and  night  missions.  Subject  matter  experts  (SMEs)  provided  the  list  of  tasks 
involved  in  controlling  a  TUAV  (during  normal  operations  and  emergencies),  the  order  of  these 
tasks,  and  the  visual,  auditory,  cognitive,  and  psychomotor  workload  values  associated  with  each 
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task.  Twelve  different  crew  configurations  were  examined  for  the  tactical  operations  center 
(TOC)  and  the  launch  and  recovery  station  (LRS),  which  ranged  in  size  from  8  to  15  crew 
members.  The  conclusions  from  executing  the  models  and  interviewing  SMEs  (during  12-  and 
18-hour  missions)  indicate  that  reducing  the  number  of  aerial  vehicle  operators  (AVOs)  and 
mission  payload  operators  (MPOs)  in  the  TOC  can  result  in  more  aerial  vehicle  mishaps  during 
emergencies,  increased  search  time,  and  a  decreased  number  of  targets  detected.  For  example, 
compared  to  six  AVOs  or  MPOs  in  the  TOC,  the  addition  of  two  crew  members  resulted  in  only 
slight  perfonnance  gains  of  a  6%  increase  in  target  detection  and  a  4%  decrease  in  target  search 
time.  However,  when  the  members  of  the  crew  were  reduced  to  four  AVOs  or  MPOs  in  the  TOC, 
there  was  substantial  perfonnance  loss  (20%  decrease  in  target  detection  and  a  15%  increase  in 
target  search  time).  The  general  conclusion  is  that  a  crew  of  12  (TOC  [two  MCs  and  six  AVOs 
or  MPOs];  LRS  [two  MCs  and  two  AVOs])  is  the  most  efficient  trade-off  between  perfonnance 
and  crew  size.  The  implications  of  these  findings  for  other  possible  crew  configurations  are 
discussed,  along  with  plans  for  further  analyses. 
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The  purpose  of  this  study  was  to  detennine  the  required  skill  set  for  common  ground 
station  of  the  future  (CGS-future)  and  compare  it  to  the  present  military  occupational  specialty 
(MOS)  96H  skill  requirements  in  order  to  detennine  the  appropriateness  of  the  96H  for  operating 
the  CGS-future.  We  approached  the  objectives  by  conducting  subject  matter  expert  and 
documentation  reviews  of  presently  accepted  training  for  MOSs  96H,  96D,  and  96B;  by 
employing  the  Job  Assessment  Software  System  (JASS)  in  order  to  assess  what  skills  and 
abilities  are  needed  for  what  duty  and  at  what  demand;  and  by  creating  a  dynamic  task-network 
perfonnance  model  to  simulate  work  flow  and  enor  rate  during  different  operating  conditions. 
Results  indicated  that  there  is  skill  shift  (higher  levels  of  analytical  skills  required)  for  the 
operator  of  the  CGS-future.  These  skill  demands  are  at  a  level  similar  to  or  higher  than  those 
required  by  MOSs  96D  and  96B.  However,  a  simple  substitution  of  the  more  analytically  trained 
MOSs  (96B  and  96D)  is  not  the  solution,  since  the  training  cost  to  learn  CGS  skills  exceeds  the 
cost  to  enhance  current  training.  The  cost-effective  approach  would  be  to  determine  what  96B 
and  96D  skills  and  how  much  of  them  must  be  integrated  into  the  96H  training.  Furthennore,  the 
complex  relationship  of  the  training  to  successful  perfonnance,  especially  under  different 
mission  demands,  is  not  validated.  Further  use  of  the  dynamic  model  to  develop  a  body  of  data 
derived  from  careful  manipulation  of  personnel  mixes  and  mission  requirements  could  provide 
valuable  advice  to  decision  makers  who  track  these  complex  issues. 
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In  support  of  our  Air  Staff  initiatives,  we  in  the  Military  Testing  Section  (Ken  Schwartz, 
Chief,  USAF  Military  Testing  and  I)  have  spent  the  last  two  months  working  to  revitalize  the 
USAF  personnel  research  program  for  strategic  force  management  issues.  This  has  consumed  a 
large  portion  of  our  attention  up  through  4:00  PM  on  Saturday,  September  30th,  the  last  day  of 
our  fiscal  year.  I  am  happy  to  report  that  we  were  successfully  in  launching  four  major  -general 
personnel  research”  contracts  totally  nearly  two  million  dollars  from  unexpected  fallout  funds.  In 
one  of  these  contracts  there  is  a  task  to  evaluate  the  effectiveness  and  potential  for  using  the  new 
Self  Description  Inventory  (SDI+)  which  has  become  part  of  the  Air  Force  Officer  Qualifying 
Test  (AFOQT)  since  August  2005.  We  now  have  nearly  10,000  AFOQT  answer  sheets  which 
represent  not  only  current  USAF  Officers,  but  also  -applicants”  in  the  sense  that  they  entered  the 
commissioning  source,  but  may  not  have  progressed  through  final  commissioning.  This  dataset 
will  be  an  invaluable  asset  in  our  first,  near-term  plans  for  evaluating  personality  measures  in  any 
future  operational  Air  Force  personnel  program. 
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Military  testing  in  the  United  States  Air  Force  (USAF)  falls  into  several  categories. 
Testing  associated  with  Education  &  Training  is  vital  for  preparing  a  team-oriented,  a  mission- 
ready  force.  The  other  forms  of  testing,  collectively  known  as  Personnel  Tests,  have  a  direct 
impact  on  defining  an  individuaPs  official  job  and  level  of  responsibility.  The  goal  of  personnel 
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testing  is  to  select,  promote,  or  certify  the  most  qualified  individuals.  The  Air  Force  Personnel 
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The  aim  of  this  pilot  study  is  to  examine  training  enlistment  standards  utilizing  Army 
Training  Requirements  and  Resources  System  (ATRRS)  training  data  which  records  individual- 
level  training  events  for  all  MOS,  but  is  limited  to  pass  /  fail  outcomes.  Specifically,  we  seek  to 
investigate  the  tradeoffs  between  training  eligibility  and  Advanced  Individual  Training  (AIT) 
completion  brought  about  through  lowering  /  raising  minimum  enlistment  training  standards,  and 
to  develop  methodologies  which  can  be  utilized  to  assist  school  proponents  in  assessing  the 
appropriateness  of  their  Aptitude  Area  (AA)  cut  scores.  For  the  initial  effort  in  this  pilot,  the  50 
MOS  investigated  belonged  to  a  handful  of  school  proponents  who  expressed  an  interest  in  the 
objectives  of  this  study,  plus  a  few  additional  ones  recommended  by  Army  Accessions 
Command.  Subsequently,  an  additional  30  MOS  that  promised  sufficient  numbers  of  (failure) 
observations  were  also  included.  The  authors  specify  and  estimate  binary  logistic  regression 
models  of  pass  /  fail  training  outcomes  over  the  2001  -  2004  period.  Training  outcome  is 
estimated  as  a  function  of  AA  governing  composite,  Soldier  demographic,  and  component 
membership  variables.  The  estimated  models  are  then  applied  to  the  larger  Anny  enlisted 
contract  population  to  examine  the  policy  tradeoffs.  For  select  MOS,  the  policy  analyses  are 
examined  more  closely  using  risk  analysis  simulation  methods. 

Williams,  G.  O.  (1940).  Flying  aptitude  tests.  London,  England:  Flying  Personnel  Research 
Committee,  Royal  Air  Force,  Ministry  of  Defense. 

Williams,  H.  P.,  Albert,  A.  O.,  &  Blower,  D.  J.  (1999).  Selection  of  officers  for  U.S.  naval 

aviation.  Paper  presented  at  the  Workshop  of  the  Research  and  Technology  Organization 
Human  Factors  and  Medicine  Panel  (HFM)  Meeting  55,  Officer  Selection  (RTO-MP-55), 
Monterey,  CA. 

This  paper  reviews  the  process  of  selecting  officers  for  U.S.  naval  aviation  training  and 
describes  one  of  the  principal  selection  tools,  the  Aviation  Selection  Test  Battery  (ASTB).  The 
1992  version  of  the  ASTB  is  a  paper-and-pencil  test  administered  to  all  applicants  for  naval 
aviation  training.  ASTB  scores  and  ground  school  and  flight  training  performance  data  were 
available  for  2852  student  naval  aviators  and  student  naval  flight  officers,  and  these  data  were 
used  to  re-assess  the  validity  of  the  ASTB  in  predicting  student  perfonnance.  The  results 
indicated  that  the  ASTB  remains  a  valid  predictor  of  ground  school  and  flight  training  grades, 
and  to  a  lesser  extent,  attrition  from  training.  For  a  small  subset  of  the  sample  used  in  these 
analyses,  data  from  a  computer-based  perfonnance  test  (CBPT)  were  also  available.  The  CBPT 
required  subjects  to  engage  in  multi-axis  tracking  tasks  concurrently  with  other  cognitive  tasks, 
such  as  dichotic  listening  and  working  memory  tasks.  Scores  from  the  ASTB,  the  CBPT,  and 
grades  from  ground  school  were  entered  into  a  linear  regression  upon  primary  flight  training 
grades.  The  results  showed  that  the  combination  of  ground  school  and  CBPT  scores  can  be  used 
as  a  good  predictor  of  perfonnance  (R2  =  .33,  p  <.0001).  Although  these  results  will  require 
cross  validation,  the  CBPT  shows  promise  as  a  new  selection  tool.  The  importance  of  these 
results  is  discussed  in  the  context  of  a  recently  developed  computer-based  version  of  the  ASTB. 

Williams,  H.  P.,  Albert,  A.  O.,  &  Blower,  D.  J.  (2000).  Selection  of  officers  for  U.S.  naval 

aviation  training.  Paper  presented  at  the  North  Atlantic  Treaty  Organization,  Research 
and  Technology  Organization  Meeting  Proceedings  No.  55,  Neuilly-sur-Seine,  France. 


271 


Williams,  H.  S.,  &  Williams,  E.  H.  (1915).  Modern  Warfare.  New  York:  Hearst's  International 
Library  Co. 

Williams,  K.  W.  (2007).  Unmanned  aircraft  pilot  medical  certification  requirements.  Oklahoma 
City,  OK:  Civil  Aerospace  Medical  Institute,  Federal  Aviation  Administration. 

This  research  study  was  undertaken  to  create  recommendations  for  unmanned  aircraft 
pilot  medical  certification  requirements.  The  effort  consisted  of  the  convening  of  a  panel  of 
subject  matter  experts  and  interactions  with  groups  engaged  in  the  process  of  establishing 
unmanned  aircraft  pilot  guidelines.  The  results  of  this  effort  were  a  recommendation  and 
justification  for  use  of  the  second-class  medical  certification. 

Williams,  L.  J.  (1995).  Peripheral  Target  Recognition  and  Visual  Field  Narrowing  in  Aviators 
and  Nonaviators.  International  Journal  of  Aviation  Psychology,  5(2),  215-232. 

Examines  accuracy  of  peripheral  target  recognition  and  visual  field  narrowing  among 
aviators  and  nonaviators.  Observation  of  larger  effective  functional  visual  fields  among  aviators; 
Susceptibility  of  nonaviators  to  visual  field  narrowing;  Effect  of  load  increases  on  aviator 
perfonnance.  Examines  accuracy  of  peripheral  target  recognition  and  visual  field  narrowing 
among  aviators  and  nonaviators.  Observation  of  larger  effective  functional  visual  fields  among 
aviators;  Susceptibility  of  nonaviators  to  visual  field  narrowing;  Effect  of  load  increases  on 
aviator  performance. 

Williams,  M.  J.,  &  Kamman,  J.  F.  (1946).  Personnel  deficiencies  responsible  for  unsuccessful 
aerial  combat  missions.  American  Psychologist,  1,  294. 

Willingham,  W.  W.  (1958).  A  note  on  peer  nominations  as  a  predictor  of  success  in  naval  flight 
training.  Pensacola,  FL:  Naval  School  of  Aviation  Medicine. 

Willingham,  W.  W.  (1958).  The  relation  of  age  to  succession  in  flight  training.  Journal  of 
Aviation  Medicine,  29,  136-138. 

Willingham,  W.  W.,  &  Ambler,  R.  K.  (1962).  Comparison  of  methods  for  deriving  peer 
nomination  scores.  Pensacola,  FL:  U.S.  Naval  School  of  Aviation  Medicine. 

Wilmer,  W.  H.  (1920).  Aviation  Medicine  in  the  A.E.F.  Washington,  D.C.:  War  Department, 
Director  of  Air  Service. 

Wilson,  C.  L.  (Ed.).  (1959).  Project  Mercury  candidate  evaluation  program.  WADC-TR-59-505 . 
Wright-Patterson  Air  Force  Base:  Wright  Air  Development  Center. 

Wilson,  D.  R.,  &  Fallshore,  M.  (2001).  Optimistic  and  ability  biases  in  pilots'  decisions  of  risk 
regarding  FVR  flight  into  IMC.  Paper  presented  at  the  1 1th  International  Symposium  on 
Aviation  Psychology,  Columbus,  OH. 

Wise,  J.  A.,  V.  D.  Hopkin,  V.  D.,  &  Garland,  D.  J.  (Eds.).  (2010).  Handbook  of  Aviation  Human 
Factors  (2nd  ed.).  New  York:  CRC  Press. 


272 


Wiskoff,  M.  F.,  &  Rampton,  G.  M.  (Eds.).  (1989).  Military  Personnel  Measurement:  Testing, 
Assignment,  Evaluation.  New  York:  Praeger. 

Wiskoff,  M.  F.,  &  Sands,  M.  M.  (1983).  Military  personnel  testing:  Past,  present,  and  future. 
Paper  presented  at  the  25th  Annual  Military  Testing  Association  Conference,  Gulf 
Shores,  AL. 

From  the  enormous  early  task  of  classifying  thousands  of  personnel  into  military 
assignments  under  the  pressure  of  World  War  I,  to  today's  state-of-the-art  work  in  computerized 
testing,  military  research  has  been  at  the  forefront  of  personnel  testing.  This  paper  will  review 
some  current  research  developments,  including  a  recent  cross-national  comparison  of  testing 
methods,  and  reflect  on  future  research  directions. 

Wong,  J.  (2005,  Fall).  SynWin  Version  1.2.  Ergonomics  in  Design,  13,  30-32. 

Woodhouse,  H.  (1917).  Textbook  of  Naval  Aeronautics.  New  York:  The  Century  Co. 

Woodhouse,  H.  (1920).  Textbook  of  Aerial  Laws  and  Regulations  for  Aerial  Navigation, 

International,  National  and  Municipal,  Civil  and  Military .  New  York:  Frederick  A. 
Stokes  Co. 

Worthington,  B.  (1993).  Pilot  selection  procedures  since  the  enactment  of  the  Americans  with 
disabilities  act  of 1990.  Paper  presented  at  the  7th  International  Symposium  on  Aviation 
Psychology,  Columbus,  OH. 

Ways  in  which  the  Americans  with  Disabilities  Act  (ADA)  effects  selection  procedures 
for  professional  pilots  are  examined  on  the  basis  of  responses  to  a  questionnaire  filled  out  by  104 
companies  with  25  or  more  employees  who  hire  pilots  with  commercial  or  air  transport  pilot 
licenses.  It  is  found  that  most  aviation  companies  see  themselves  in  compliance  with  ADA.  The 
compliance  did  not  require  a  great  deal  of  time,  effort  or  money.  Most  companies  surveyed  had 
to  make  some  changes  in  the  pilot  selection  procedures;  the  biggest  changes  were  in  the  areas  of 
the  medical  examination  and  the  pilot  application  form.  (AIAA) 

Woycheshin,  D.  (2001).  Analysis  of  Canadian  Automated  Pilot  Selection  System  (CAPSS) 
results.  Ottawa,  ON:  Chief  of  Air  Staff. 

Woycheshin,  D.  (2001).  Relationships  between  paper  and  pencil  tests,  CAPSS  results  and 
Primary  Flying  Training  results.  Ottawa,  ON:  Chief  of  Air  Staff. 

Woycheshin,  D.  (2001).  Validation  of  the  Canadian  Automated  Pilot  Selection  System  (CAPSS) 
against  primary  flying  training  results.  Ottawa,  ON:  Chief  of  Air  Staff. 

Woycheshin,  D.  (2002).  Validation  of  the  Aircrew  Test  Series.  Ottawa,  ON:  Chief  of  Air  Staff. 

Woychesin,  D.  E.  (1999).  CAPSS:  The  Canadian  automated  pilot  selection  system.  Paper 

presented  at  the  Workshop  of  the  Research  and  Technology  Organization  Human  Factors 
and  Medicine  Panel  (HFM)  Meeting  55,  Officer  Selection  (RTO-MP-55),  Monterey,  CA. 


273 


Woychesin,  D.  E.  (2002).  Validation  of  the  Canadian  Automated  Pilot  Selection  System 
(CAPSS)  against  primary  flying  training  results.  Canadian  Journal  of  Behavioural 
Science,  34(2),  84-91. 

Xiao,  W.,  Miao,  D.,  Wang,  J.,  Liu,  X.,  Luo,  Z.,  Liu,  P., .  .  .  Liu,  F.  (2002).  Psychological 

selection  of  pilots  in  civil  aviation  with  the  Uchida-Kraepelin  test.  Chinese  Mental  Health 
Journal,  16(4),  249-251. 

Yerkes,  R.  (1918).  Psychology  in  relation  to  the  war.  Psychological  Review,  25(2),  85-115. 

Yerkes,  R.  M.  (1919).  Report  of  the  psychology  committee  of  the  National  Research  Council. 
Psychological  Review,  26(2),  83-149. 

Yerkes,  R.  M.  (Ed.).  (1920).  The  New  World  of  Science:  It's  Development  During  the  War.  New 
York:  The  Century  Company. 

Yerkes,  R.  M.  (Ed.).  (1921).  Psychological  Examining  in  the  United  States  Army  (Vol.  XV). 
Washington,  DC:  Government  Printing  Office. 

Yoakum,  C.  S.,  &  Yerkes,  R.  M.  (Eds.).  (1920).  Army  Mental  Tests.  New  York:  Henry  Hollt  and 
Company. 

Young,  W.  Y.  (2002).  Update  of  U.S.  Army  Research  Institute's  Officer  Personnel  Research 
Data  Bases  for  1999  and  2000.  Alexandria,  VA:  U.S.  Anny  Research  Institute  for  the 
Behavioral  and  Social  Sciences. 

Youngling,  E.  W.,  Levine,  S.  H.,  Mocharnuk,  J.  B.,  &  Weston,  L.  M.  (1977).  Feasibility  study  to 
predict  combat  effectiveness  for  selected  military  roles:  fighter  pilot  effectiveness.  East  St 
Louis,  MO:  McDonnell  Douglas  Astronautics  Co. 

This  study  focuses  upon  enhancing  the  U.S.  record  of  air-to-air  combat  kills  through 
more  stringent  and  comprehensive  selection  procedures.  Specifically,  it  presents  empirical 
evidence  which  demonstrates  that  a  program  can  be  developed  to  select  pilots  who  will  be 
effective  in  air-to-air  combat.  Developing  such  a  selection  program  involves  a  job  analysis  of  the 
fighter  pilot  task,  the  generation  of  testable  trait  hypotheses,  the  development  of  predictor 
variables  and  peacetime  and  combat  criteria,  and  validation  and  cross  validation  during 
peacetime  and  during  combat.  Forty-five  factors  were  identified  only  10  of  which  are  adequately 
evaluated  within  a  current  U.S.  military  selection  program  upon  initial  entrance  into  pilot 
training.  Assessment  of  the  35  untapped  factors  is  within  technological  reach;  in  fact,  many  of 
these  factors  can  be  assessed  by  tests  which  are  presently  available. 

Youngling,  E.  W.,  Levine,  S.  H.,  Mocharnuk,  J.  B.,  &  Weston,  L.  M.  (1977).  Notes  on  the 

feasibility  of predicting  fighter  pilot  effectiveness.  Paper  presented  at  the  19th  Annual 
Military  Testing  Association  Conference,  San  Antonio,  TX. 

History  has  demonstrated  that  there  is  a  pressing  need  for  improved  selection  and  training 
of  fighter  pilots.  In  World  War  II.  only  one  of  twenty  pilots  became  an  ace.  The  U.S.  Air  Force 
kill  ratio  in  Southeast  Asia  was  approximately  2.5  to  1.  In  contrast,  the  Israelis  claim  to  have  had 


274 


a  kill  ratio  of  60  to  1 .  Our  feasibility  study  has  focused  upon  enhancing  our  record  of  air-to-dir 
Combat  kills  through  more  stringent  and  comprehensive  selection  procedures.  Evidence  is 
presented  which  demonstrates  that  a  program  can  be  developed  to  select  pilots  who  will  be 
effective  in  air-to-air  Combat.  From  reviews  of  U.S.  and  foreign  selection  research  dating  from 
World  War  II  to  the  present  and  the  assessment  of  pilot  opinion  from  hundreds  of  aces,  45 
factors  were  identified  as  potential  predictors  of  fighter  pilot  combat  effectiveness.  Of  these  45 
factors,  only  10  are  adequately  evaluated  within  current  military  selection  programs  upon 
entrance  into  pilot  training.  Assessment  of  the  remaining  35  untapped  factors  is  within  our 
technological  reach.  In  fact,  many  of  these  factors  can  be  assessed  by  tests  which  are  presently 
available.  We  developed  an  Air  Combat  Effectiveness  Study  (ACES)  program  which  would 
establish  selection  test  measures  for  virtually  all  of  the  factors  identified  as  underlying  fighter 
pilot  combat  effectiveness.  As  part  of  the  ACES  program,  selection  test  measures  would  be 
validated  against  perfonnance  in  air  combat  maneuvering  ranges,  thereby  providing  a  method  for 
selecting  fighter  pilots  during  peacetime.  We  have  emphasized  selection  for  success  in  the 
operational  environment  rather  than  success  in  training.  Armed  with  these  selection  test  scores 
and  an  effectively  executed  validation  program,  researchers  should,  for  the  first  time  in  history, 
be  able  to  specify  a  definitive  profile  of  the  ace  fighter  pilot. 

Youtz,  R.  P.  (1946).  Objective  measures  of  flying  skill  for  the  first  20  hours  of  Anny  pilot 
training.  American  Psychologist,  1,  294. 

Zaccaria,  L.,  &  Cox,  J.  A.  (1947).  Differential  validity  of  the  Aircrew  Classification  Battery 
(February  1947)  for  assignment  to  basic  pilot  training.  Lackland  Air  Force  Base,  TX: 

U.S.  Air  Force  Human  Resources  Research  Center. 

Zaccaria,  L.,  &  Cox,  J.  A.  (1952).  Comparison  of  aviation  cadets  and  student  officers  in  primary 
pilot  training.  Lackland  Air  Force  Base,  TX:  USAF  Human  Resources  Research  Center. 

Zaccaria,  M.  A.,  Dailey,  J.  T.,  Tupes,  E.  C.,  Stafford,  A.  R.,  Lawrence,  H.  G.,  &  Ailsworth,  K.  A. 
(1956).  Development  of  an  interview  procedure  for  USAF  officer  applicants.  Lackland 
Air  Force  Base,  TX:  Air  Force  Personnel  and  Training  Research  Center. 

Zachert,  V.,  and  Friedman,  G.  (1953).  The  stability  of  the  factorial  pattern  of  aircrew 
classification  tests  in  four  analyses.  Psychometrika,  18(3),  219-224. 

This  study  consists  of  four  factor  analyses  of  the  Army  Air  Forces  Aircrew  Classification 
Batteries.  The  first  was  an  analysis  of  the  1945  wartime  battery,  while  the  other  three  were 
analyses  of  the  1947  postwar  battery,  consisting  of  essentially  the  same  variables,  but  using 
different  samples.  Eleven  factors  were  found  which  had  been  identified  and  reported  in  previous 
analyses.  An  additional  factor,  possibly  an  artifact,  was  identified  as  an  age-education  doublet. 
The  only  factor  which  differed  significantly  in  the  analyses  was  pilot  or  flying  interest.  These 
factor  analyses  show  that  the  factorial  content  of  the  tests  remains  quite  similar  in  both  wartime 
and  postwar  populations.  The  data  reported  in  this  study  were  collected  as  part  of  the  United 
States  Air  Force  Human  Resources  Research  and  Development  Program  and  described  in 
Research  Bulletin  52-16.  The  opinions  or  conclusions  contained  in  this  report  are  those  of  the 
authors.  They  are  not  to  be  construed  as  reflecting  the  view  or  indorsement  of  the  Department  of 
the  Air  Force. 


275 


Zachert,  V.,  &  Friedman,  G.  (1952).  Factorial  comparisons  of  two  aircrew  classification  batteries 
with  and  without  the  variable  of  previous  flying  experience.  Lackland  Air  Force  Base, 

TX:  U.S.  Air  Force  Human  Resources  Research  Center. 

Zachert,  V.,  &  Shibe,  E.  (1951).  Analysis  of  principles,  organization,  and  classification  for 

optimum  selection  and  classification.  Lackland  AFB,  TX:  Human  Resources  Research 
Center. 

Zedeck,  S.,  Tziner,  A.,  &  Middlestadt,  S.  E.  (1983).  Interviewer  validity  and  reliability:  An 
individual  analysis  approach.  Personnel  Psychology,  36,  355-370. 

Zeidner,  J.,  &  Drucker,  A.  J.  (1988).  Behavioral  Science  in  the  Army:  A  Corporate  History  of  the 
Army  Research  Institute.  Alexandria,  VA:  U.S.  Army  Research  Institute  for  the 
Behavioral  and  Social  Sciences 

Zeidner,  J.,  Goldstein,  L.  G.,  Sprunger,  J.  A.,  &  Karcher,  E.  K.  (1956).  Evaluation  of  fixed  wing 
selection  tests  for  predicting  success  in  Anny  helicopter  pilot  training:  U.  S.  Army 
Adjutant  General's  Personnel  Research  Branch. 

Zeidner,  J.,  Johnson,  C.,  Vladimirsky,  Y.,  &  Weldon,  S.  (2002).  Detennining  Composite  Validity 
Coefficients  for  Army  Jobs  and  Job  Families  (pp.  181).  Alexandria,  VA:  U.S.  Anny 
Research  Institute  for  the  Behavioral  and  Social  Sciences. 

Zeidner,  J.,  Johnson,  C.,  Vladimirsky,  Y.,  &  Weldon,  S.  (2003).  Detennining  Mean  Predicted 
Perfonnance  for  Anny  Job  Families.  Alexandria,  VA:  U.S.  Army  Research  Institute  for 
the  Behavioral  and  Social  Sciences. 

Zeidner,  J.,  Martinek,  H.,  &  Anderson,  A.  A.  (1958).  Evaluation  of  experimental  predictors  for 
selecting  Anny  helicopter  pilot  trainees:  II.:  U.  S.  Army  Adjutant  General's  Personnel 
Research  Branch. 

Zeidner,  J.,  Martinek,  H.,  &  Klieger,  W.  A.  (1958).  Analysis  of  flight  evaluations  of  Army 
helicopter  pilot  trainees:  U.  S.  Anny  Adjutant  General's  Personnel  Research  Branch. 

Zeidner,  J.,  Martinek,  R.,  &  Anderson,  A.  A.  (1958).  Evaluation  of  experimental  predictors  for 
selecting  Anny  helicopter  pilot  trainees:  I:  U.  S.  Army  Adjutant  General's  Personnel 
Research  Branch. 

Zeidner,  J.,  Van  Steenberg,  N.  J.,  &  Anderson,  A.  A.  (1958).  Prediction  of  success  in  the  Army 
Cargo  Helicopter  Pilot  course.  Alexandria,  VA:  Anny  Research  Institute  for  the 
Behavioral  and  Social  Sciences. 

Ziebel,  T.  S.  (1989).  Policy  issues  for  Air  Force  personnel  testing  programs .  Paper  presented  at 
the  31st  Annual  Military  Testing  Association  Conference,  San  Antonio,  TX. 

The  Air  Force  Military  Personnel  Center  (AFMPC)  has  been  the  office  of  primary 


276 


responsibility  (OPR)  for  Air  Force  personnel  testing  programs  since  1970.  As  the  OPR,  we  are 
responsible  for  the  development  of  plans,  policies,  and  procedures  necessary  to  monitor  and 
implement  all  Air  Force  personnel  testing  programs.  Whenever  a  new  personnel  test  is 
implemented,  AFMPC  must  establish  the  policies  and  procedures  necessary  for  proper  test 
administration  and  control  of  the  data.  Therefore,  we  are  intimately  involved  in  the  planning  and 
operational  implementation  of  the  Basic  Attributes  Test  (BAT)  which  will  be  used  as  a  selection 
and  classification  tool  in  the  new  Pilot  Selection  and  Classification  System  (PSACS).  Our  role  as 
the  policy-maker  will  be  to  establish  all  testing  requirements  for  the  BAT  under  the  Air  Force 
test  control  system.  We  will  provide  guidance  and  regulate  procedures  for  test  administration, 
security  of  the  test  data,  retest  policy,  and  a  variety  of  other  issues. 

Zifkin,  B.  G.  (2005).  The  electroencephalogram  as  a  screening  tool  in  pilot  applicants.  Epilepsy 

&  Behavior,  6(1),  17-20. 

The  electroencephalogram  (EEG)  is  used  to  screen  pilot  candidates  for  professional 
licensure  irrespective  of  medical  history  in  many  European  countries;  applicants  with 
paroxysmal  abnormalities  are  excluded.  The  aim  is  to  reduce  the  risk  of  later  seizures  in  flight, 
which  may  cause  accident  or  death,  but  there  is  no  clear  evidence  that  EEG  screening  can  lead  to 
any  significant  risk  reduction.  This  is  partly  due  to  the  low  predictive  value  of  the  EEG,  the  low 
risk  of  seizure  in  healthy  young  adults,  and  the  low  risk  of  commercial  aircraft  accidents.  Later- 
onset  seizures,  unrelated  to  the  results  of  earlier  screening,  cannot  be  predicted  or  prevented  by 
screening.  Some  benefit  cannot  be  excluded,  but  may  be  difficult  to  demonstrate  in  prospective 
studies.  Specialized  screening  of  targeted  populations,  such  as  for  photosensitivity  in  helicopter 
pilot  candidates,  may  be  justifiable;  prospective  studies  with  standardized  recording  and 
interpretation  protocols  are  needed  to  assess  this. 

Zuliani,  R.  A.  (1983).  Sex  differences  in  aircrew  selection.  Paper  presented  at  the  25th  Annual 

Military  Testing  Association  Conference,  Gulf  Shores,  AL. 


277 


